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EXECUTIVE  SUMMARY 


The  objective  of  this  project  was  to  demonstrate  the  performance  of  an  electromagnetic  system 
optimized  for  detection  of  small  ordnance  targets,  such  as  20mm  and  37mm  projectiles,  at  depths 
greater  than  the  standard  “llx  diameter”  metric  currently  employed.  The  performance  goal  for 
this  project  was  20x  the  target  diameter.  Classification  of  targets  was  not  an  expressed  objective 
of  the  project,  except  that  considerable  non-ordnance  items  of  this  size  were  expected  to  be 
detected  by  the  system,  so  an  approach  for  excluding  these  items  from  dig  lists  was  needed. 
Classification  of  the  sort  demonstrated  by  cued  instruments  was  beyond  the  expected  capabilities 
of  the  data  produced  by  this  instrument.  Ultimately,  classification  using  inversion 
polarizabilities  proved  both  possible  and  effective. 

A  total  of  four  field  operations  were  carried  out.  The  first  was  a  feasibility  study  using  the  one 
half  of  the  existing  airborne  system  without  modification.  The  second  was  an  initial  shake-down 
of  the  modified  system  to  determine  the  optimal  field  settings  (base  frequency,  survey  speed, 
platform  configuration,  transmitter  power,  vehicle  offset,  filter  parameters,  etc.).  The  third  was  a 
preliminary  field  test  to  ensure  proper  operability  of  the  system  at  the  specified  settings  before 
the  fourth  and  final  demonstration. 

The  initial  feasibility  study  was  conducted  prior  to  the  contract  award.  The  feasibility  study  and 
initial  shake-down  were  both  conducted  at  the  Camp  Sibert  Geophysical  Prove  Out  (GPO)  grid 
with  the  assistance  of  the  U.S.  Army  Engineering  Support  Center,  Huntsville  (USAESCH).  The 
preliminary  field  test  was  conducted  at  Battelle’s  West  Jefferson,  Ohio  UXO  Test  Grid.  The 
final  demonstration  was  conducted  at  the  Aberdeen  Proving  Ground  (APG)  Geophysical  Test 
Center. 

This  project  met  all  of  the  original  expectations  for  small  target  detection  at  depth,  and  greatly 
exceeded  expectations  in  terms  of  discrimination  and  classification.  For  the  medium  and  large 
targets  at  normal  depths  (25mm- 105mm  down  to  1  lx  diameter),  results  were  nearly  perfect  with 
a  vertical  ROC  curve.  For  the  small  targets  at  greater  depths  (20mm-40mm  down  to  20x 
diameter)  all  targets  were  detected  at  depths  down  to  20x  diameter  burial  depth  (Pd  100%),  and 
all  except  the  20mm  targets  could  be  discriminated  with  100%  Pdisc.  The  20mm  targets  had 
Pdisc  reduced  to  0.87/0.90  (capped/uncapped),  primarily  at  the  greater  depths.  The  ROC  curve 
for  these  was  very  good,  but  not  as  vertical  as  for  the  medium/large  targets.  Classification  of 
clutter  (Pec)  was  slightly  lower  than  the  corresponding  Pdisc,  reflecting  a  cautious  approach  to 
declarations.  Pec  was  0.87  in  the  Blind  Grid,  and  0.52/0.61  in  the  Small  Target  Grid.  This  last 
metric  was  the  only  one  that  came  close  to  falling  below  the  design  expectations  of  0.60.  All 
metrics  surpassed  those  of  the  existing  technology  benchmark  (EM-61  array).  Originally 
intended  purely  as  a  detection  tool  and  replacement  for  the  standard  EM-61  array,  this  system 
has  demonstrated  superior  depth  detection  and  comparable  discrimination  capabilities  to  other 
dynamic  classification  tools  as  demonstrated  at  the  APG  site. 
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1.0  INTRODUCTION 


The  objective  of  this  project  was  to  demonstrate  detection  of  small  ordnance  targets,  such  as 
20mm  and  37mm  projectiles,  at  depths  greater  than  the  standard  “1  lx  diameter”  metric  currently 
employed.  This  will  reduce  the  cost  and  improve  the  reliability  of  remedial  actions.  The 
technology  being  demonstrated  was  an  extension  of  the  Battelle  airborne  TEM-8  electromagnetic 
system.  The  essential  electronics  and  data  acquisition  system  remained  the  same,  but  the 
transmitter  and  receiver  configurations  were  optimized  for  these  specific  targets  based  on 
theoretical  modeling  results.  This  report  details  the  feasibility  study,  optimization  modeling, 
field  testing  and  demonstration  of  the  new  TEM-8g  system. 


1.1  BACKGROUND 

The  detection  of  very  small  ordnance  items  (e.g.  20mm  and  37mm  projectiles)  is  difficult  due  to 
the  low  amplitude  magnetic  and  electromagnetic  response  of  such  items.  The  standard  rule  for 
maximum  burial  detection  depth  is  llx  the  target  diameter.  Several  factors  alter  actual 
performance  including  ground  clearance  of  the  instrument.  This  is  particularly  true  for  small 
targets  where  the  ground  clearance  becomes  a  relatively  large  percentage  of  the  total  offset 
distance.  Detection  depths  for  standard  instruments  (e.g.  EM-61  arrays)  are  therefore  typically 
limited  to  approximately  0.41m  for  37mm  (llx  diameter)  but  only  about  0.15m  for  20mm  (8x 
diameter)  (Nelson,  et  ah,  2009).  The  magnetic  response  is  often  comparable  to  that  of  local 
geologic  and  soil  response.  The  electromagnetic  response  is  relatively  immune  to  geology,  but 
standard  instruments  do  not  produce  sufficient  power  to  energize  such  small  targets  above 
background  noise,  especially  at  late  times.  The  combination  of  low  signal-to-noise  and  a  lack  of 
sufficient  “look-angles”  with  standard  instruments  makes  target  classification  difficult.  Also,  the 
spatial  resolution  of  standard  sensors,  particularly  across-line,  may  be  too  coarse  to  reliably  or 
accurately  locate  individual  small  or  weak  targets,  even  with  sensor  arrays. 

This  new  system  is  a  ground-based  version  of  the  successful  Battelle  TEM-8  airborne 
electromagnetic  sensor  platform.  It  features  a  single  large  transmitter  with  eight  small  receivers 
on  a  vehicle-towed  platform.  It  differs  from  existing  technologies  primarily  in  its  focus  on 
detecting  the  response  from  small  and  deep  targets  by  maximizing  the  power  of  the  transmitter 
field  and  the  resolution  of  the  receivers.  The  more  powerful  transmitter  field  increases  the 
probability  that  the  target  response  will  exceed  the  noise  threshold  and  decreases  the  variability 
of  that  response,  all  leading  to  higher  detection  capabilities.  The  transmitter  retains  the 
“alternating  castle”  waveform  with  a  50%  duty  cycle  and  user  programmable  base  frequencies 
from  the  original  airborne  system. 

There  are  several  benefits  to  the  new  system.  Classification  of  the  quality  demonstrated  by  cued 
instruments  was  beyond  the  expected  capabilities  of  this  instrument  because  of  the  lack  of 
multiple  “look-angles”  at  the  target.  Ultimately,  classification  using  inversion  polarizabilities 
proved  both  possible  and  effective.  In  addition  to  the  increased  peak  response,  the  rectangular 
transmitter  produces  sufficiently  strong  horizontal  fields  to  enable  multiple  look-angles  and 
subsequent  polarizability  inversion  of  the  measured  data.  These  inversion  results  can  be  used  to 
discriminate  clutter  from  ordnance,  and  to  classify  ordnance  by  type,  thereby  reducing  the 
number  of  false  positive  excavations. 
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By  increasing  the  detection  depth  for  these  targets,  remedial  actions  will  not  have  to  be 
conducted  in  “lifts”  with  successive  geophysical  surveys,  reacquisitions  and  removals  at  six-inch 
depth  intervals.  And  the  improved  classification  can  reduce  the  overall  number  of  excavations 
required.  The  net  result  is  higher  efficiency  and  reduced  cost  for  ordnance  clean  up  for  these 
typically  difficult  targets. 


1.2  OBJECTIVE  OF  THE  DEMONSTRATION 

The  objective  of  this  project  was  to  demonstrate  the  performance  of  an  electromagnetic  system 
optimized  for  detection  of  small  ordnance  targets,  such  as  20mm  and  37mm  projectiles,  at  depths 
greater  than  the  standard  “llx  diameter”  metric  currently  employed.  The  performance  goal  for 
this  project  was  20x  the  target  diameter.  Classification  of  targets  was  not  an  expressed  objective 
of  the  project,  except  that  considerable  non-ordnance  items  of  this  size  were  expected  to  be 
detected  by  the  system,  so  an  approach  for  excluding  these  items  from  dig  lists  was  needed.  No 
other  instruments  have  been  rigorously  tested  for  detection  of  20mm  projectiles  or  for  detection 
of  larger  ordnance  at  depths  greater  than  llx  diameter.  Without  a  prior  point  of  comparison, 
objective  demonstration  criteria  were  extrapolated  from  published  performance  results  and 
design  expectations. 


1.3  REGULATORY  DRIVERS 

There  are  no  known  regulatory  drivers  relevant  to  the  acceptance  and  use  of  this  technology. 
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2.0  TECHNOLOGY 


The  technology  demonstrated  was  a  ground-based  extension  of  the  Battelle  TEM-8  airborne 
time-domain  electromagnetic  system,  named  the  TEM-8g.  The  success  of  the  airborne  system  at 
detecting  ordnance  at  large  offsets  prompted  the  development  of  a  ground-based  system  to  detect 
small  ordnance  items  at  greater  depths  than  had  been  previously  possible. 

2.1  TECHNOLOGY  DESCRIPTION 

The  technology  is  based  on  the  principles  of  time-domain  electromagnetic  theory.  Current 
through  a  transmitter  loop  generates  a  secondary  electromagnetic  field  within  a  metallic  target. 
When  the  current  is  shut  off  rapidly,  the  decay  of  the  secondary  field  is  measured  at  different 
locations  by  a  receiver  coil  (Figure  la). 


Figure  1:  (a-left)  Theoretical  model  of  primary  and  secondary  electromagnetic  fields, 
(b-right)  Photo  of  Battelle  airborne  TEM-8  system. 

The  airborne  predecessor  to  the  current  instrument  was  developed  with  ESTCP  support  between 
2001  and  2004  under  project  MM-200101.  Internal  Battelle  research  funds  were  used  to  extend 
the  prototype  system  to  a  production  capable  system,  the  TEM-8.  A  subsequent  ESTCP- 
supported  demonstration  of  the  Battelle  TEM-8  airborne  system  was  conducted  between  2008 
and  2009  under  ESTCP  project  MM-0743  (Figure  lb).  Results  from  TEM-8  airborne  tests  at 
Battelle’s  UXO  Test  Site  near  Columbus,  Ohio  showed  a  Pd  of  53%  for  60mm  mortars  at  an 
average  2m  sensor  height.  Improvements  were  made  to  the  TEM-8  system  subsequent  to  the 
Ohio  test,  and  prior  to  a  demonstration  at  the  Former  Kirtland  Precision  Bombing  Range 
(FKPBR),  NM  in  2009.  Results  from  this  blind-seeded  test  at  FKPBR  showed  a  99%  Pd  for 
buried  targets  as  small  as  81mm  mortars  for  similar  flight  altitudes. 
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2.2  TECHNOLOGY  DEVELOPMENT 


The  ground-based  version  of  Battelle’s  TEM-8  (Figure  2,  TEM-8g)  uses  the  same  electronic 
instrumentation  as  the  airborne  system  with  a  modified  transmitter  and  receiver  configuration. 
Physics-based  modeling  was  used  to  determine  the  optimum  size  of  the  receivers.  The  optimal 
combination  of  resolution  and  response  amplitude  was  obtained  when  the  receiver  size  was 
approximately  the  same  as  the  offset  between  the  target  and  the  center  of  the  receiver.  Smaller 
receivers  had  lower  response  amplitude  without  improved  resolution.  Larger  receivers  had 
higher  amplitudes  (up  to  a  point)  but  degraded  resolution  due  to  averaging  too  much  background. 
To  maximize  resolution  for  surface  targets  given  a  nominal  ground  clearance  of  approximately 
20cm,  a  receiver  diameter  of  20cm  was  adopted.  The  transmitter  size  was  then  optimized  to 
produce  the  largest  possible  peak  response  and  uniform  amplitude  at  each  receiver  across  the 
array.  A  square  transmitter  produced  a  strong  response  from  deep  targets,  but  a  rectangular 
transmitter  produced  more  uniform  results  from  surface  targets.  A  range  of  transmitter  shapes 
were  modeled  with  length:width  ratios  between  1:1  and  6:1.  Ultimately,  a  size  of  2.5m  x  0.75m 
(3.3:1)  was  chosen  as  a  compromise  between  near-surface  symmetry  and  deep  signal  strength. 


Figure  2:  Schematic  (a-left)  and  photo  (b-right)  of  the  TEM-8g  system.  Red  lines  on  schematic 


show  transmitter  and  receiver  coils.  Schematic  shows  wheeled  option,  photo  shows  ski  option. 


Sled  option  not  shown. 


MR-201105  Final  Report 


5 


After  completion  of  the  modeling  task,  the  transmitter  and  receiver  array  were  constructed  and 
deployed  in  a  brief  field  test  to  establish  the  basic  operating  parameters.  This  was  conducted  at 
the  Camp  Sibert  Geophysical  Prove  Out  (GPO)  grid.  A  fiberglass  platform  was  constructed  that 
could  accommodate  either  wheels  or  skis,  and  both  platform  types  were  tested.  Electronic  tests 
included  response  amplitude  and  consistency  across  the  array  with  a  20mm  target  at  various 
orientations  and  offset  heights  using  different  base  frequencies.  Signaknoise  calculations  were 
made  for  all  combinations.  Three  different  power  levels  in  the  transmitter  were  also  compared  to 
find  the  optimum  signaknoise  ratio.  Finally,  the  system  was  used  to  survey  a  set  of  buried  20mm 
projectiles  at  depths  between  10cm  and  60cm  (5x  and  30x  diameter). 

Based  on  these  tests,  a  set  of  operating  parameters  was  established  to  produce  the  optimal 
signaknoise.  The  first  is  the  transmitter  power,  which  was  established  at  60A  and  12  coil  turns. 
This  maximized  the  response  amplitude  from  deep  targets,  but  retained  a  sufficiently  fast  current 
shut-off  that  early  time  data  were  not  lost.  The  second  parameter  was  using  the  base  frequency, 
set  at  30Hz,  to  maximize  the  off-time  decay.  This  differed  from  the  airborne  application  which 
typically  requires  a  base  frequency  of  225Hz  to  optimize  the  rejection  of  rotor  noise.  No 
stacking  of  pulses  was  required.  Sensor  height  was  optimized  by  being  as  close  to  the  ground  as 
possible,  although  this  may  increase  the  response  from  the  magnetic  susceptibility  of  the  soil. 
The  wheeled  platform  proved  easier  to  tow  (less  friction)  but  tended  to  bounce,  especially  at 
speeds  in  excess  of  2m/s.  The  skis  were  more  difficult  to  tow  but  produced  a  smoother  ride.  The 
tow  vehicle  contained  the  motor,  the  console  and  the  electrical  generator.  An  offset  of  >4m  from 
the  vehicle  to  the  sensors  was  required  for  the  vehicle  noise  to  drop  below  the  static  instrument 
noise. 

Static  noise  levels  were  approximately  O.lSppm  with  dynamic  noise  levels  of  O.Sppm  -  l.Sppm 
depending  on  the  platform  type  and  tongue  length.  Responses  were  symmetric  across  the  array 
in  accordance  with  the  modeling  estimates.  Response  amplitude  attenuation  with  depth  ranged 
from  f  for  a  horizontal  20mmP  targets  to  f  for  a  vertical  20mmP.  This  is  consistent  with  a 
uniform  primary  field  and  a  dipole  secondary  field,  as  would  be  expected  for  a  small  target  in  the 
near-field  of  a  large  transmitter. 

Static  tests  demonstrated  detection  of  a  20mmP  at  100cm  offset  with  a  10:1  signaknoise  ratio.  In 
dynamic  tests,  the  20mmP  were  only  detectable  to  40cm  depth  (60cm  offset)  due  to  the  increased 
noise  from  motion  and  background  soil  response.  Response  profiles  varied  depending  on  the 
target  orientation.  Vertical  targets  demonstrated  a  single  peak  signature,  whereas  horizontal 
targets  aligned  in  the  direction  of  travel  demonstrated  a  double  peak.  Horizontal  targets  aligned 
perpendicular  to  the  direction  of  travel  demonstrated  a  single  peak  with  an  amplitude  comparable 
to  the  local  minimum  between  the  double  peaks  of  a  transverse  target.  Measured  results  fit 
extremely  well  with  modeled  data. 

Inversion  of  single-pass  data  showed  that  the  primary  polarizabilities  were  well  defined,  but  the 
secondaries  were  rather  poor  due  to  the  lack  of  orthogonal  look  angles.  No  orthogonal  survey 
data  were  acquired  as  part  of  this  field  test.  Calibration  of  the  instrument  response  data  and  the 
dipole  inversion  algorithms  were  developed  by  SAIC  based  on  this  and  subsequent  field  tests. 
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Figure  3:  Plots  of  measured  and  modeled  EM  response  across  the  array  (receivers  1-8)  over 
vertical  and  horizontal  20mm  targets  from  Camp  Sibert  field  test. 
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Full  inversion  results  suitable  for  target  classification  require  multiple  look  angles  derived  from 
orthogonal  survey  passes.  As  the  transmitter  passes  over  a  target,  it  energizes  it  along  two  axes  - 
vertical  and  in-line  (ZX).  A  second  survey  pass  in  the  orthogonal  survey  direction  provides  the 
third  axis.  Each  pass  energizes  the  target  along  the  entire  ZX  plane.  The  results  are  inverted  for 
target  location  and  depth,  fit  coefficient,  target  inclination  and  declination,  and  the  polarizability 
((3)  decays.  The  amplitude  of  the  primary  and  secondary  (3,  and  the  power  of  the  primary  decay 
provide  a  three-dimensional  parameter  space  for  classification.  The  amplitude  of  the  primary 
and  secondary  P  are  plotted  to  determine  the  relative  size  and  proportion  of  the  target.  The  decay 
power  provides  an  additional  measure  of  classification  related  to  conductivity.  This  has  been 
useful  in  discriminating  between  same-size  frag,  as  well  as  between  sub-classes  of  ordnance  (e.g. 
37mm  projectiles  with  and  without  rotating  bands).  Rule-based  classification  routines  are  used 
within  this  parameter  space  to  differentiate  targets  of  interest  from  clutter  items.  Where  multiple 
targets  are  clearly  identified  within  a  single  inversion  set,  multi-dipole  models  can  be  used  to 
invert  for  both  targets. 

The  TEM-8g  therefore  consists  of  a  single  high-power  Z-axis  transmitter  2.5m  x  0.75m  in  size 
(Figure  2a).  Eight  0.20m  diameter  Z-axis  receivers  are  set  out  in  a  line  on  0.22m  centers  forming 
an  array  1.75m  wide  along  the  center  of  the  transmitter.  Data  are  sampled  at  30Hz  and  the  array 
is  towed  behind  a  utility  vehicle  at  approximately  1.5m/s.  The  result  is  a  high-resolution  (0.22m 
X  0.05m)  dataset  that  can  be  processed  and  gridded  using  the  same  basic  tools  as  the  standard 
EM61  (filter,  level,  grid).  Unlike  the  EM61,  however,  the  results  can  be  used  for  effective 
inversion  if  bi-directional  (orthogonal)  survey  data  are  available. 

Positioning  is  provided  by  post-processed  DGPS.  Platform  orientation  is  provided  by  multiple 
GPS  antennas  and  a  moving  baseline  calculation.  Nominal  accuracy  is  0.02m  for  the  GPS 
antenna  location  and  0.1  deg  for  pitch/roll/heading. 


2.3  ADVANTAGES  AND  LIMITATIONS  OF  THE  TECHNOLOGY 

The  industry  standard  technology  for  this  application  is  an  array  of  Geonics  EM61-Mk2  sensors. 
Like  the  TEM-8g,  the  EM61  is  a  mono-static  time-domain  electromagnetic  sensor,  but  consists 
of  a  single  transmitter  with  a  single  receiver  of  the  same  size.  Arrays  of  three  EM61  sensors  are 
common.  These  fire  and  record  each  sensor  in  sequence  across  the  array.  The  advantages  of  the 
TEM-8g  system  as  compared  to  the  EM61-MK2  include:  (a)  higher  transmitter  power,  response 
amplitudes  and  signaknoise  at  depths  between  0-lm,  (b)  digital  rather  than  analog  filters,  (c) 
higher  resolution  receiver  configuration  (8  receivers  at  20cm  rather  than  1  at  100cm)  improves 
detection,  positioning  and  inversion  results  for  shallow  targets,  (d)  wider  swath  width,  (e) 
variable  sample  rate  (user  selection)  to  optimize  for  local  background  noise  sources  and  (f) 
reliable  discrimination  and  classification  capabilities.  The  limitation  of  the  TEM-8g  is  that  it  is 
not  readily  configurable  into  a  man-portable  system  due  to  the  higher  power  requirements.  As 
with  other  towed  arrays,  it  is  typically  not  amenable  to  surveying  in  densely  wooded  or  vegetated 
areas,  or  on  steep  slopes. 
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3.0  PERFORMANCE  OBJECTIVES 


Performance  objectives  for  the  demonstration  at  APG  and  success  levels  for  each  objective  are 
summarized  in  Table  1. 

The  TEM-8g  is  a  new  electromagnetic  system  which  does  not  have  a  performance  baseline  from 
which  success  criteria  could  be  derived.  Two  metrics  were  therefore  presented  for  most 
objectives.  One  was  the  current  performance  metric  of  the  closest  available  technology  -  the 
Geonics  EM61-MK2.  The  second  was  the  design  objective  of  the  Battelle  project  team.  The 
final  evaluation  is  whether  the  performance  exceeded  the  industry  standard  and/or  the  design 
objectives. 

Design  objectives  were  set  by  the  Battelle  project  team  based  on  initial  field  test  measurements. 
Metrics  for  the  EM61-MK2  were  drawn  from  the  ESTCP  live-site  demonstration  results  at  San 
Louis  Obispo  for  the  medium  and  large  targets,  and  from  the  ESTCP  Camp  Butner 
demonstration  for  the  small  targets.  However,  there  is  only  general  correlation  between  these 
demonstrations  and  the  objectives  listed  here  for  APG.  Neither  site  included  20mm  targets.  For 
example,  the  San  Louis  Obispo  site  had  mostly  medium  sized  targets  (no  large,  no  small), 
whereas  the  Camp  Butner  site  included  37mm,  105mm  and  155mm  projectiles,  but  no  20mm 
projectiles  at  any  depth.  Therefore,  detection  and  classification  metrics  for  the  current  state  of 
the  art  are  considered  reasonable  estimates  based  on  published  results,  but  may  not  fully 
represent  the  targets  assessed  in  this  project. 

Classification  metrics  for  the  APG  Small  Grid  are  divided  into  capped  and  uncapped  subgroups, 
reflecting  ESTCP’s  seeding  of  additional  surface  clutter  items  in  some  of  the  cells.  The 
uncapped  group  replicates  the  standard  seeding  procedure  used  throughout  the  APG 
demonstration  facility  where  the  area  around  the  target  has  been  cleared  of  all  metallic  debris. 
The  capped  group  has  deliberate  clutter  items  placed  directly  on  top  of  the  target  location  in 
order  to  mask  the  signature  and  make  classification  more  difficult.  This  is  closer  to  what  may  be 
presumed  to  be  found  in  a  live-site  situation  rather  than  a  typical  controlled  test  plot. 
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Table  1:  Performance  Objectives.  Green,  yellow  and  red  cells  reflect  the  level  of  success  in 
meeting  the  stated  objective. 


Performance  Objective 

Metric 

Data  Required 

Success 

Criteria 

Results 

Quantitative  Performance  Objectives 

Detection  of  med/large 
munitions  at  current  detection 
depths  to  1  lx  diameter  (Blind 
Grid) 

Percent  detected  of 
seeded  items 
(Response  stage) 

•  Prioritized  dig  list 

•  Analysis  of  Blind 

Grid 

Design 

Pd=1.00 

Current 

Pd=1.00 

1.00 

Detection  of  small  munitions  at 
current  detection  depths  to  1  lx 
diameter  (Small  Target  Grid) 
(0-0.2m  for  20-mm 

0-0. 4m  for  37-mm) 

Percent  detected  of 
seeded  items 
(Response  stage) 

•  Prioritized  dig  list 

•  Analysis  of  Small 
Target  Grid 

Design 

Pd=0.95 

Current 

Pd=0.75 

1.00 

Detection  of  small  munitions  at 
deeper  detection  depths  to  20x 
diameter  (Small  Target  Grid) 
(0.2-0.4m  for  20-mm, 

0.4-0. 75m  for  37-mm) 

Percent  detected  of 
seeded  items 
(Response  stage) 

•  Prioritized  dig  list 

•  Analysis  of  Small 
Target  Grid 

Design 

Pd=0.85 

Current 

Pd=0.00 

1.00 

Classification  of  med/large 
munitions  at  current  detection 
depths  to  1  lx  diameter  (Blind 
Grid) 

Percent  of  correctly 
classified  items 
(Discrim  stage) 

•  Prioritized  dig  list 

•  Analysis  of  Blind 

Grid 

Design 

Pdisc=0.80 

Current 

Pdisc=0.50 

1.00 

Classification  of  small 
(37mm/40mm)  munitions  at 
deeper  detection  depths  to  20x 
diameter  (Small  Target  Grid) 

Percent  of  correctly 
classified  items 
(Discrim  stage) 

•  Prioritized  dig  list 

•  Analysis  of  Small 
Target  Grid 

Design 

Pdisc=0.70 

Current 

Pdisc=0.25 

1.00/1.00 

(cap/uncap) 

Classification  of  small  (20mm) 
munitions  at  deeper  detection 
depths  to  20x  diameter  (Small 
Target  Grid) 

Percent  of  correctly 
classified  items 
(Discrim  stage) 

•  Prioritized  dig  list 

•  Analysis  of  Small 
Target  Grid 

Design 

Pdisc=0.60 

Current 

Pdisc=0.00 

0.87/0.90 

(cap/uncap) 

Classification  of  clutter  against 
med/large  munitions  at  current 
detection  depths  to  1  lx 
diameter  (Blind  Grid) 

Percent  of  clutter 
items  declared  as 
clutter. 

(Discrim  stage) 

•  Prioritized  dig  list 

•  Analysis  of  Blind 

Grid 

Design 

Pcc=0.80 

Current 

Pcc=0.50 

0.87 

Classification  of  clutter  against 
small  munitions  at  deeper 
detection  depths  to  20x 
diameter  (Small  Target  Grid) 

Percent  of  clutter 
items  declared  as 
clutter. 

(Discrim  stage) 

•  Prioritized  dig  list 

•  Analysis  of  Small 
Target  Grid 

Design 

Pcc=0.60 

Current 

Pcc=0.00 

0.52/0.61 

(cap/uncap) 

Location  accuracy 

Average  error  and 
standard  deviation 
of  depth  estimates 
for  seed  items 

•  Location  of  seed 
items 

•  Estimated  location 
from  analysis  of 
geophysics  data 

AZ  <0.10  m 

aZ  <0.10  m 

AO. 05m 

a0.04m 

Production  rate 

Number  of  acres  of 
data  collection  per 
day. 

•  Log  of  field  work  and 
data  analysis  time 
accurate  to  1 5 
minutes 

Survey  1  ac/hr 
(or  0.5  ac/hr 
with  bi-dir 
surveying) 

0.73  ac/hr 
(0.36  ac/hr 
with  bi-dir 
surveying) 

Qualitative  Performance  Objectives 

Ease  of  use 

•  Feedback  from 
technician  on 
usability 

Comparable 
to  EM61 
array 
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3.1  OBJECTIVE:  LARGE  TARGET  DETECTION  AT  llx  DIAMETER 


The  first  objective  is  to  match  the  industry  performance  of  the  best  available  alternative 
technology  for  medium  and  large  targets.  This  is  represented  by  the  expectation  that  standard 
sensor  systems  can  detect  targets  at  a  depth  of  roughly  1  lx  the  target  diameter.  While  there  is 
some  overlap  of  target  types  with  the  Small  Target  Grid,  this  demonstration  objective  is  met 
primarily  by  the  Blind  Grid. 


3.1.1  Metric 

Compare  the  Response  Stage  dig  list  against  the  known  seed  item  list  at  depths  between  0-1  lx 
diameter  for  all  targets  in  the  Blind  Grid. 


3.1.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  dig  list  prioritized  by  response  size  generated  from  the 
geophysical  data. 


3.1.3  Success  Criteria 

The  Response  Stage  dig  list  will  be  compared  to  the  list  of  known  seed  items  (within  the  depth 
range  specified).  Probability  of  detection  (Pd)  will  be  calculated  for  each  type  of  seed  item  and 
intermediate  depth  range.  A  Pd  of  1.00  constitutes  success. 

3.1.4  Conclusion 

This  objective  was  fully  met.  The  Pd  for  all  ordnance  types  at  all  depths  was  1.00  in  the 
Response  Stage. 
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3.2  OBJECTIVE:  SMALL  TARGET  DETECTION  AT  llx  DIAMETER 


The  second  objective  is  to  match  or  exceed  the  industry  performance  of  the  best  available 
alternative  technology  for  small  targets.  This  is  represented  by  the  expectation  that  the  standard 
sensor  system  can  detect  targets  at  a  depth  of  roughly  llx  the  target  diameter.  While  there  is 
some  overlap  of  target  types  with  the  Blind  Grid,  this  demonstration  objective  is  met  primarily 
by  the  Small  Target  Grid. 


3.2.1  Metric 

Compare  the  Response  Stage  dig  list  against  the  known  seed  item  list  at  depths  between  0-1  lx 
diameter  for  all  targets  in  the  Small  Target  Grid. 


3.2.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  dig  list  prioritized  by  response  size  generated  from  the 
geophysical  data. 


3.2.3  Success  Criteria 

The  Response  Stage  dig  list  will  be  compared  to  the  list  of  known  seed  items  (within  the  depth 
range  specified).  Probability  of  detection  (Pd)  will  be  calculated  for  each  type  of  seed  item  and 
intermediate  depth  range.  The  design  objective  is  a  Pd  of  0.95,  but  a  Pd  greater  than  0.75 
represents  an  improvement  on  existing  technology.  Existing  technologies  will  detect  the  37mm 
and  40mm  targets  at  this  depth,  but  struggle  to  detect  the  smaller  20mm  targets. 


3.2.4  Conclusion 

This  objective  was  fully  met.  The  Pd  for  all  ordnance  types  at  all  depths  was  1.00  in  the 
Response  Stage. 
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3.3  OBJECTIVE:  SMALL  TARGET  DETECTION  AT  20x  DIAMETER 

This  objective  represents  the  original  inspiration  for  this  demonstration.  It  is  to  test  the  outer 
limits  of  the  detection  capabilities  for  small  targets.  This  is  represented  by  the  expectation  that 
the  sensor  system  can  detect  targets  at  a  depth  of  roughly  20x  the  target  diameter.  This 
demonstration  objective  is  met  by  the  Small  Target  Grid. 

3.3.1  Metric 

Compare  the  Response  Stage  dig  list  against  the  known  seed  item  list  at  depths  between  12-20x 
diameter  for  all  targets  in  the  Small  Target  Grid. 


3.3.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  dig  list  prioritized  by  response  size  generated  from  the 
geophysical  data. 


3.3.3  Success  Criteria 

The  Response  Stage  dig  list  will  be  compared  to  the  list  of  known  seed  items  (within  the  depth 
range  specified).  Probability  of  detection  (Pd)  will  be  calculated  for  each  type  of  seed  item  and 
intermediate  depth  range.  The  design  objective  is  a  Pd  of  0.85,  but  a  Pd  greater  than  0.00 
represents  an  improvement  on  existing  technology,  due  to  the  fact  that  existing  technologies  have 
difficulty  detecting  these  targets  even  at  depths  of  1  lx  diameter. 


3.3.4  Conclusion 

This  objective  was  fully  met.  The  Pd  for  all  ordnance  types  at  all  depths  was  1.00  in  the 
Response  Stage. 
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3.4  OBJECTIVE:  LARGE  TARGET  CLASSIFICATION  AT  llx  DIAMETER 


This  objective  is  slightly  beyond  the  original  scope  of  the  project,  except  that  target  lists  need  to 
be  sorted  in  such  a  way  as  to  eliminate  as  much  of  the  clutter  as  possible.  Ordnance  items  are 
first  classified  into  a  single  group  regardless  of  type.  All  other  detected  responses  are  assumed  to 
be  clutter.  This  assumes  that  the  characteristics  of  all  possible  ordnance  types  encountered 
during  the  survey  are  known  ahead  of  time.  This  demonstration  objective  is  met  by  the  Blind 
Grid  with  targets  between  25mm  and  105mm  in  size  at  burial  depths  down  to  1  lx  diameter. 


3.4.1  Metric 

Compare  the  Discrimination  Stage  dig  list  against  the  known  seed  item  list  at  depths  between  0- 
1  lx  diameter  for  all  targets  in  the  Blind  Grid. 


3.4.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  classified  dig  list  generated  from  the  geophysical  data. 


3.4.3  Success  Criteria 

The  Discrimination  Stage  dig  list  will  be  compared  to  the  list  of  known  seed  items  (within  the 
depth  range  specified).  Probability  of  successfully  classifying  an  ordnance  item  as  ordnance 
(Pdisc)  will  be  calculated  for  the  Blind  Grid.  The  design  objective  is  a  Pdisc  of  0.80,  but  a  Pdisc 
greater  than  0.50  represents  an  improvement  on  existing  technology. 

3.4.4  Conclusion 

This  objective  was  fully  met.  The  Pdisc  for  all  ordnance  types  at  all  depths  was  1.00  in  the 
Discrimination  Stage. 
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3.5  OBJECTIVE:  37mm/40mm  CLASSIFICATION  AT  20x  DIAMETER 


This  objective  is  slightly  beyond  the  original  scope  of  the  project,  except  that  target  lists  need  to 
be  sorted  in  such  a  way  as  to  eliminate  as  much  of  the  clutter  as  possible.  Ordnance  items  are 
first  classified  into  a  single  group  regardless  of  type.  All  other  detected  responses  are  assumed  to 
be  clutter.  This  assumes  that  the  characteristics  of  all  possible  ordnance  types  encountered 
during  the  survey  are  known  ahead  of  time.  This  demonstration  objective  is  met  by  the  Small 
Target  Grid  for  the  37mm  and  40mm  targets  at  burial  depths  down  to  20x  diameter. 
Classification  of  targets  in  this  range  is  more  difficult  than  the  larger  targets  because  the  small 
size  and  greater  depth  leads  to  much  lower  signahnoise  responses.  In  addition,  a  cap  of  clutter 
was  added  to  make  classification  more  difficult. 


3.5.1  Metric 

Compare  the  number  of  ordnance  declarations  against  the  known  seed  item  list  at  depths  between 
0-20x  diameter  for  the  37mm/40mm  targets  in  the  Small  Target  Grid. 


3.5.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  classified  dig  list  generated  from  the  geophysical  data. 


3.5.3  Success  Criteria 

The  Discrimination  Stage  dig  list  will  be  compared  to  the  list  of  known  seed  items  (within  the 
depth  range  specified).  Probability  of  successfully  classifying  an  ordnance  item  as  ordnance 
(Pdisc)  will  be  calculated  for  the  Blind  Grid.  The  design  objective  is  a  Pdisc  of  0.70,  but  a  Pdisc 
greater  than  0.25  represents  an  improvement  on  existing  technology,  primarily  due  to  the  20x 
burial  depth. 


3.5.4  Conclusion 

This  objective  was  fully  met.  The  Pdisc  for  all  ordnance  types  at  all  depths  was  1.00  in  the 
Discrimination  Stage,  whether  the  cell  was  capped  or  uncapped. 
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3.6  OBJECTIVE:  20mm  CLASSIFICATION  AT  20x  DIAMETER 


This  objective  is  slightly  beyond  the  original  scope  of  the  project,  except  that  target  lists  need  to 
be  sorted  in  such  a  way  as  to  eliminate  as  much  of  the  clutter  as  possible.  Ordnance  items  are 
first  classified  into  a  single  group  regardless  of  type.  All  other  detected  responses  are  assumed  to 
be  clutter.  This  assumes  that  the  characteristics  of  all  possible  ordnance  types  encountered 
during  the  survey  are  known  ahead  of  time.  This  demonstration  objective  is  met  by  the  Small 
Target  Grid  with  20mm  targets  at  burial  depths  down  to  20x  diameter.  Classification  of  targets 
in  this  range  is  more  difficult  than  the  larger  targets  because  the  small  size  and  greater  depth 
leads  to  much  lower  signahnoise  responses.  In  addition,  a  cap  of  clutter  was  added  to  make 
classification  more  difficult. 


3.6.1  Metric 

Compare  the  number  of  ordnance  declarations  against  the  known  seed  item  list  at  depths  between 
0-20x  diameter  for  the  20mm  targets  in  the  Small  Target  Grid. 


3.6.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  classified  dig  list  generated  from  the  geophysical  data. 


3.6.3  Success  Criteria 

The  Discrimination  Stage  dig  list  will  be  compared  to  the  list  of  known  seed  items  (within  the 
depth  range  specified).  Probability  of  successfully  classifying  an  ordnance  item  as  ordnance 
(Pdisc)  will  be  calculated  for  the  Blind  Grid.  The  design  objective  is  a  Pdisc  of  0.60,  but  a  Pdisc 
greater  than  0.00  represents  an  improvement  on  existing  technology,  due  to  the  fact  that  existing 
technologies  cannot  even  detect  these  targets  at  depths  to  20x  diameter. 


3.6.4  Conclusion 

This  objective  was  fully  met.  The  Pdisc  for  all  ordnance  types  at  all  depths  was  0.87  (capped) 
and  0.90  (uncapped)  in  the  Discrimination  Stage. 
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3.7  OBJECTIVE:  LARGE  CLUTTER  CLASSIFICATION  AT  llx  DIAMETER 


This  objective  is  slightly  beyond  the  original  scope  of  the  project,  except  that  target  lists  need  to 
be  sorted  in  such  a  way  as  to  eliminate  as  much  of  the  clutter  as  possible.  The  purpose  of  this 
metric  is  to  counter  the  tendency  to  declare  all  responses  as  ordnance  in  order  to  maximize  Pd. 
Clutter  items  are  classified  into  a  single  group  by  exclusion.  That  is,  anything  that  cannot  be 
clearly  identified  as  ordnance  defaults  to  clutter.  This  assumes  that  the  characteristics  of  all 
possible  ordnance  types  encountered  during  the  survey  are  known  ahead  of  time.  This 
demonstration  objective  is  met  by  the  Blind  Grid  with  targets  between  25mm  and  105mm  in  size 
at  burial  depths  down  to  1  lx  diameter. 

3.7.1  Metric 

Compare  the  number  of  clutter  declarations  against  the  known  seed  item  list  at  depths  between  0- 
1  lx  diameter  for  all  targets  in  the  Blind  Grid. 


3.7.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  classified  dig  list  generated  from  the  geophysical  data. 


3.7.3  Success  Criteria 

The  Discrimination  Stage  dig  list  will  be  compared  to  the  list  of  known  seed  items  (within  the 
depth  range  specified).  Probability  of  successfully  classifying  clutter  as  clutter  (Pcc)  will  be 
calculated  for  the  Blind  Grid.  The  design  objective  is  a  Pcc  of  0.80,  but  a  Pcc  greater  than  0.50 
represents  an  improvement  on  existing  technology. 


3.7.4  Conclusion 

This  objective  was  fiilly  met.  The  Pcc  for  all  clutter  sizes  at  all  depths  was  0.87  in  the 
Discrimination  Stage. 
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3.8  OBJECTIVE:  SMALL  CLUTTER  CLASSIFICATION  AT  20x  DIAMETER 


This  objective  is  slightly  beyond  the  original  scope  of  the  project,  except  that  target  lists  need  to 
be  sorted  in  such  a  way  as  to  eliminate  as  much  of  the  clutter  as  possible.  The  purpose  of  this 
metric  is  to  counter  the  tendency  to  declare  all  responses  as  ordnance  in  order  to  maximize  Pd. 
Clutter  items  are  classified  into  a  single  group  by  exclusion.  That  is,  anything  that  cannot  be 
clearly  identified  as  ordnance  defaults  to  clutter.  This  assumes  that  the  characteristics  of  all 
possible  ordnance  types  encountered  during  the  survey  are  known  ahead  of  time.  This 
demonstration  objective  is  met  by  the  Small  Target  Grid  with  targets  between  20mm  and  40mm 
in  size  at  burial  depths  down  to  20x  diameter.  Differentiation  of  clutter  from  smaller  and  deeper 
ordnance  is  more  difficult  than  for  larger  targets  due  to  the  greater  overlap  in  size  and  the  lower 
signahnoise  ratio. 


3.8.1  Metric 

Compare  the  number  of  clutter  declarations  against  the  known  seed  item  list  at  depths  between  0- 
20x  diameter  for  all  targets  in  the  Small  Target  Grid. 


3.8.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  classified  dig  list  generated  from  the  geophysical  data. 


3.8.3  Success  Criteria 

The  Discrimination  Stage  dig  list  will  be  compared  to  the  list  of  known  seed  items  (within  the 
depth  range  specified).  Probability  of  successfully  classifying  clutter  as  clutter  (Pcc)  will  be 
calculated  for  the  Small  Target  Grid.  The  design  objective  is  a  Pcc  of  0.60,  but  a  Pcc  greater 
than  0.00  represents  an  improvement  on  existing  technology,  primarily  due  to  the  fact  that 
existing  technologies  cannot  even  detect  targets  at  this  size  and  depth. 


3.8.4  Conclusion 

This  objective  was  met  for  the  uncapped,  but  not  the  capped  cells.  The  Pcc  for  all  clutter  sizes  at 
all  depths  was  0.52  (capped)  and  0.61  (uncapped)  in  the  Discrimination  Stage.  In  contrast,  the 
Pd  was  relatively  unchanged  for  this  grouping  (see  sections  3.5.4  and  3.6.4).  This  would  indicate 
that  the  emplaced  clutter  cap  had  a  greater  impact  in  disguising  clutter  than  ordnance.  In  effect  it 
made  the  clutter  look  like  ordnance;  presumably  by  adding  sufficient  ambiguity  to  the  inversion 
results  that  the  clutter  was  classified  as  ordnance. 
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3.9  OBJECTIVE:  LOCATION  ACCURACY 


Location  accuracy  is  a  combination  of  GPS  precision,  sensor  resolution  (controlled  in  this  system 
primarily  by  receiver  size  and  target  depth),  geophysical  data  processing  and  inversion  fit.  All 
seed  items  will  be  geo-referenced  prior  to  the  survey.  Horizontal  (XY)  and  vertical  (Z)  location 
estimates  are  provided  by  the  inversion  results  and  scored  against  the  ground  truth. 


3.9.1  Metric 

The  average  offset  error  and  standard  deviation  in  depth  will  be  computed  for  all  detected 
targets. 


3.9.2  Data  Requirements 

The  number,  location  and  depth  of  all  seed  items  within  the  test  grid  must  be  known  to  ESTCP. 
The  survey  results  must  be  analyzed  and  a  dig  list  with  target  locations  and  depths  generated 
from  the  geophysical  data. 


3.9.3  Success  Criteria 

The  offset  error  in  depth  for  each  declaration  will  be  calculated  for  the  Small  Target  Grid  for 
targets  at  all  depths.  The  average  and  standard  deviation  will  be  calculated.  The  average  error  is 
a  measure  of  the  location  accuracy,  whereas  the  standard  deviation  is  a  measure  of  the  precision. 
An  average  error  of  <0.10m  and  a  standard  deviation  of  <0.10m  constitutes  success. 


3.9.4  Conclusion 

This  objective  was  fully  met.  Target  locations  were  provided  for  the  Calibration  Grids  only. 
Horizontal  locations  were  assumed  to  be  the  center  of  the  cell.  The  mean  and  standard  deviation 
of  the  depth  errors  were  0.05m  and  0.04m  respectively.  The  mean  and  standard  deviation  of  the 
horizontal  radial  error  were  0.08m  and  0.05m  (see  plot  page  43).  A  consistent  offset  of  0.046m 
may  be  the  result  of  a  documented  slip  in  the  base  station  GPS  tripod  during  the  survey. 
Allowing  for  this  adjustment,  the  horizontal  and  vertical  accuracy  may  be  described  as  0.05m 
with  a  standard  deviation  of  0.05m. 
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3.10  OBJECTIVE:  PRODUCTION  RATE 


This  objective  tests  the  potential  utility  of  the  system  in  a  production  setting.  The  test  grids  are 
small  enough  that  they  are  not  expected  to  take  more  than  one  day  to  survey.  As  a 
demonstration,  however,  several  passes  using  different  parameter  settings  is  planned  over  several 
days.  Daily  production  rates  will  be  estimated  from  field  logs  to  determine  overall  efficiency. 


3.10.1  Metric 

The  number  of  acres  of  data  collected  per  day  will  be  calculated  from  field  logs.  This  will 
require  some  pro-rating  of  the  numbers. 


3.10.2  Data  Requirements 

Detailed  start  and  end  times  of  each  survey  run  can  be  obtained  from  the  data  timestamps.  Field 
logs  will  detail  the  size  of  the  area  in  terms  of  the  number  and  length  of  lines  (long  lines  being 
more  efficient  than  shorter  ones),  as  well  as  the  mobilization,  setup  and  demobilization  times 
required. 


3.10.3  Success  Criteria 

A  calculated  production  rate  of  1  acre/hour  (or  0.5  acre/hour  for  bi-directional  surveying)  or 
more  constitutes  success. 


3.10.4  Conclusion 

This  objective  was  not  fully  met.  Production  rates  were  measured  at  0.73  acre/hour  (0.36  acre/hr 
for  bi-directional).  Improvements  in  productivity  may  be  obtained  with  additional  experience 
and  confidence.  For  example;  fewer  stops  to  check  instrument  functionality  or  to  make 
adjustments  would  reduce  the  time  on  the  grid. 
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4.0  SITE  DESCRIPTION 


4.1  SITE  SELECTION 

Two  demonstration  sites  are  included  in  this  report.  The  first  is  the  Battelle  UXO  Test  Grid  in 
West  Jefferson,  Ohio.  This  site  was  used  to  conduct  a  shakedown  survey  of  the  new  system 
prior  to  the  final  demonstration  at  the  Standardized  UXO  Technology  Demonstration  Site  at 
Aberdeen  Proving  Ground,  Maryland.  The  results  from  the  APG  demonstration  were  used  to 
assess  system  performance  addressed  in  Section  3. 


4.2  SITE  HISTORY 

The  West  Jefferson  site  (6ac.)  was  originally  established  in  2006  to  test  the  detection  capabilities 
of  the  Battelle  airborne  geophysical  systems.  It  includes  73  targets  ranging  in  sizes  from  60mm 
mortars  to  155mm  projectiles  at  depths  from  near  surface  to  1  lx  the  target  diameter.  Prior  to  the 
shakedown  survey,  an  additional  49  targets  were  added  representing  small  munitions  for  this  test. 
These  included  20mm  projectiles,  37mm  projectiles  and  20mm-sized  frag.  Burial  depths  were 
between  5x  and  20x  the  target  diameter. 


Figure  4:  GoogleEarth  image  of  West  Jefferson  UXO  Test  Grid  (green  trapezoidal  field).  Small 
munitions  sub-area  is  shown  in  blue.  Map  shows  intersection  of  interstate  1-70  and  Ohio  State 
Route  142  for  reference. 
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Table  2:  West  Jefferson  Small  Munitions  items  seeded  2012. 


Cell  ID 

Easting 

Northing 

Depth 

Type 

Orientation 

501 

307239.685 

4426900.637 

0.10 

frag 

vert 

502 

307244.859 

4426900.477 

0.10 

frag 

NS 

503 

307249.745 

4426900.359 

0.10 

frag 

EW 

504 

307254.813 

4426900.506 

0.10 

frag 

random 

505 

307259.719 

4426900.697 

0.30 

frag 

EW 

506 

307264.724 

4426900.494 

0.30 

frag 

NS 

507 

307269.736 

4426900.572 

0.30 

frag 

vert 

508 

307239.732 

4426895.596 

0.10 

20mm-P 

vert 

509 

307244.796 

4426895.467 

0.10 

20mm-P 

NS 

510 

307249.779 

4426895.458 

0.10 

20mm-P 

EW 

511 

307254.894 

4426895.317 

0.10 

20mm-P 

random 

512 

307259.699 

4426895.398 

0.30 

frag 

random 

513 

307264.807 

4426895.548 

0.35 

37mm-P 

EW 

514 

307269.818 

4426895.608 

0.35 

37mm-P 

random 

515 

307239.791 

4426890.446 

0.20 

20mm-P 

vert 

516 

307244.748 

4426890.523 

0.20 

20mm-P 

NS 

517 

307249.680 

4426890.456 

0.20 

20mm-P 

EW 

518 

307254.947 

4426890.510 

0.20 

20mm-P 

random 

519 

307259.749 

4426890.438 

0.40 

frag 

vert 

520 

307264.792 

4426890.522 

0.35 

37mm-P 

NS 

521 

307269.896 

4426890.603 

0.35 

37mm-P 

vert 

522 

307239.811 

4426885.639 

0.30 

20mm-P 

vert 

523 

307244.739 

4426885.527 

0.30 

20mm-P 

NS 

524 

307249.784 

4426885.622 

0.30 

20mm-P 

EW 

525 

307254.991 

4426885.401 

0.30 

20mm-P 

random 

526 

307259.812 

4426885.423 

0.40 

frag 

random 

527 

307264.810 

4426885.511 

0.20 

frag 

EW 

528 

307269.959 

4426885.661 

0.20 

frag 

random 

529 

307239.788 

4426880.629 

0.40 

20mm-P 

vert 

530 

307244.784 

4426880.421 

0.40 

20mm-P 

NS 

531 

307249.704 

4426880.350 

0.40 

20mm-P 

EW 

532 

307254.927 

4426880.600 

0.40 

20mm-P 

random 

533 

307259.802 

4426880.492 

0.40 

frag 

EW 

534 

307264.949 

4426880.512 

0.20 

frag 

NS 

535 

307270.056 

4426880.599 

0.20 

frag 

vert 

536 

307239.843 

4426875.574 

0.70 

37mm-P 

vert 

537 

307244.738 

4426875.600 

0.70 

37mm-P 

NS 

538 

307249.863 

4426875.594 

0.70 

37mm-P 

EW 

539 

307254.917 

4426875.489 

0.70 

37mm-P 

random 

540 

307259.915 

4426875.532 

0.40 

frag 

NS 

541 

307264.838 

4426875.504 

0.50 

37mm-P 

EW 

542 

307269.978 

4426875.458 

0.50 

37mm-P 

random 

543 

307239.825 

4426870.583 

0.15 

37mm-P 

vert 

544 

307244.787 

4426870.575 

0.15 

37mm-P 

NS 

545 

307249.880 

4426870.490 

0.15 

37mm-P 

EW 

546 

307254.848 

4426870.586 

0.15 

37mm-P 

random 

547 

307259.820 

4426870.508 

0.40 

frag 

vert 

548 

307264.852 

4426870.467 

0.50 

37mm-P 

NS 

549 

307269.800 

4426870.665 

0.50 

37mm-P 

vert 
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Figure  5:  Photos  of  typical  small  munitions  seed  items  used  at  the  West  Jefferson  UXO  Test 
Grid,  (top  left)  20mm  projectile,  bottom  left  20mm-sized  frag,  (top  right)  37mm  projectile 
without  rotating  band,  (bottom  right)  37mm  projectile  with  rotating  band. 
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The  final  demonstration  site  included  four  areas  of  the  Standardized  UXO  Technology 
Demonstration  Site  at  Aberdeen  Proving  Ground.  These  were:  Calibration  Grid  (0.30ac.),  Small 
Calibration  Grid  (0.03ac.),  Blind  Grid  (0.40ac.),  and  Small  Target  Grid  (0.70ac.).  The  site 
topography  was  extremely  flat  and  the  vegetation  included  mowed  grass  and  dirt.  Apart  from  the 
Calibration  Grid,  no  instrument  verification  strip  (IVS)  had  been  emplaced.  There  was  a  single 
sandy  pit  near  the  Calibration  Grid  that  was  used  for  clean  background  measurements.  The 
Small  Target  Grid  is  the  newest  addition  to  the  site  and  has  not  been  used  by  any  other 
contractor. 


Figure  6:  GoogleEarth  image  of  APG  Standardized  Test  Grid  areas  (blue). 
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Table  3:  List  of  seed  items  at  the  APG  Calibration  grid.  Only  items  in  Rows  E-K  are  present  in 
the  Blind  Grid. 


Cell  ID 

North 

East 

Type 

Depth 

Azimuth 

Dip 

Wt(g) 

A1 

4369618.797 

402765.914 

155mmP 

0.70 

45.5 

3.1 

25606 

A2 

4369614.927 

402766.675 

2.75"  Rocket 

0.18 

42.1 

5.0 

4060 

A3 

4369610.947 

402767.327 

40mmP 

0.00 

351.3 

9.6 

975 

A4 

4369607.001 

402768.072 

40mmP 

0.11 

70.9 

5.0 

975 

A5 

4369603.042 

402768.783 

2.75"  Rocket 

0.34 

122.0 

-0.3 

4060 

A6 

4369599.107 

402769.500 

155mmP 

1.08 

114.2 

3.4 

25606 

B1 

4369619.540 

402769.812 

57mmP 

0.32 

46.9 

3.5 

2722 

B2 

4369615.609 

402770.528 

20mmP 

0.23 

27.3 

0.0 

91 

B3 

4369611.661 

402771.278 

BDU-28 

0.23 

na 

na 

771 

B4 

4369607.738 

402772.000 

BDU-28 

0.17 

na 

na 

771 

B5 

4369603.784 

402772.728 

20mmP 

0.19 

82.5 

-8.7 

91 

B6 

4369599.858 

402773.509 

57mmP 

0.32 

107.6 

14.0 

2722 

C1 

4369620.284 

402773.732 

BLU-26 

0.12 

na 

na 

431 

C2 

4369616.342 

402774.458 

BLU-26 

0.14 

na 

na 

431 

C3 

4369612.415 

402775.198 

Clutter-Frag 

0.11 

na 

na 

51 

C4 

4369608.429 

402775.972 

Clutter-Frag 

0.20 

na 

na 

98 

C5 

4369604.530 

402776.624 

M42 

0.21 

na 

na 

159 

C6 

4369600.564 

402777.403 

M42 

0.23 

na 

na 

159 

D1 

4369620.983 

402777.683 

Clutter-Frag 

0.14 

na 

na 

2006 

D2 

4369617.145 

402778.403 

Clutter-Frag 

0.02 

na 

na 

1004 

D3 

4369613.154 

402779.136 

Clutter-Frag 

0.15 

na 

na 

251 

D4 

4369609.290 

402779.847 

Clutter-Frag 

0.12 

na 

na 

503 

D5 

4369605.282 

402780.611 

Clutter-Frag 

0.08 

na 

na 

1508 

D6 

4369601.321 

402781.343 

Clutter-Frag 

0.04 

na 

na 

1791 

E1 

4369621.687 

402781.636 

105mm(IF) 

0.05 

na 

na 

13608 

E2 

4369617.860 

402782.312 

81mm(IF) 

0.11 

na 

na 

3153 

E3 

4369613.862 

402783.108 

37mm(DF) 

0.09 

na 

na 

870 

E4 

4369609.944 

402783.797 

25mm(DF) 

0.04 

na 

na 

498 

E5 

4369606.010 

402784.567 

60mm(IF) 

0.05 

na 

na 

1315 

E6 

4369602.059 

402785.254 

105mm(DF) 

0.04 

na 

na 

9072 

F1 

4369622.500 

402785.470 

25mm(DF) 

0.20 

16.1 

-1.2 

498 

F2 

4369618.527 

402786.250 

25mm(DF) 

0.19 

41.5 

12.1 

498 

F3 

4369614.585 

402787.001 

25mm(DF) 

0.30 

15.4 

-4.3 

498 

F4 

4369610.622 

402787.730 

25mm(DF) 

0.30 

105.4 

-3.1 

498 

F5 

4369606.673 

402788.440 

25mm(DF) 

0.26 

286.9 

33.8 

498 

F6 

4369602.776 

402789.195 

25mm(DF) 

0.26 

109.3 

8.0 

498 

G1 

4369623.208 

402789.435 

37mm(DF) 

0.17 

91.6 

3.1 

870 

G2 

4369619.283 

402790.194 

37mm(DF) 

0.24 

81.1 

-3.3 

870 

G3 

4369615.329 

402790.898 

37mm(DF) 

0.34 

35.0 

16.5 

870 

G4 

4369611.395 

402791.683 

37mm(DF) 

0.39 

81.4 

7.8 

870 

G5 

4369607.431 

402792.342 

37mm(DF) 

0.30 

110.6 

5.7 

870 

G6 

4369603.496 

402793.131 

37mm(DF) 

0.18 

121.2 

17.7 

870 

H1 

4369623.964 

402793.415 

60mm(IF) 

0.34 

45.3 

21.1 

1315 

H2 

4369620.060 

402794.092 

60mm(IF) 

0.33 

36.7 

27.0 

1315 

H3 

4369616.017 

402794.808 

60mm(IF) 

0.55 

37.6 

13.4 

1315 

H4 

4369612.116 

402795.556 

60mm(IF) 

0.60 

117.4 

5.3 

1315 

H5 

4369608.184 

402796.333 

60mm(IF) 

0.28 

109.3 

7.7 

1315 

H6 

4369604.222 

402797.084 

60mm(IF) 

0.34 

112.8 

-4.3 

1315 

11 

4369624.637 

402797.348 

81mm(IF) 

0.43 

42.9 

12.4 

3153 

I2 

4369620.660 

402798.001 

81mm(IF) 

0.49 

44.5 

11.1 

3153 

I3 

4369616.725 

402798.789 

81mm(IF) 

0.60 

32.1 

16.0 

3153 

I4 

4369612.869 

402799.510 

81mm(IF) 

0.62 

121.3 

15.2 

3153 

I5 

4369608.902 

402800.265 

81mm(IF) 

0.53 

123.8 

13.2 

3153 

I6 

4369604.987 

402800.918 

81mm(IF) 

0.35 

111.8 

10.7 

3153 

MR-201105  Final  Report 


25 


Table  4:  List  of  seed  items  at  the  APG  Small  Target  Calibration  Grid.  These  items  are  seeded  in 


the  Small  Target  Blind  Grid.  Depths  in  this  calibration  grid  are  limited  to  1  lx  diameter. 


Cell  ID 

North 

East 

Type 

Depth 

Azimuth 

Dip 

Wt(g) 

A1 

4369586.010 

402823.648 

20mmP 

0.088 

351.5 

19.9 

91 

A2 

4369586.538 

402826.621 

20mmP 

0.126 

341.8 

19.6 

91 

A3 

4369587.096 

402829.583 

20mmP 

0.123 

353.6 

7.2 

91 

A4 

4369587.646 

402832.526 

20mmP 

0.132 

355.5 

3.6 

91 

A5 

4369588.201 

402835.456 

20mmP 

0.189 

340.6 

18.4 

91 

A6 

4369588.747 

402838.439 

20mmP 

0.223 

345.1 

16.2 

91 

B1 

4369583.040 

402824.223 

37mmP 

0.222 

349.2 

4.5 

870 

B2 

4369583.604 

402827.197 

37mmP 

0.242 

356.1 

11.1 

870 

B3 

4369584.161 

402830.081 

37mmP 

0.221 

343.2 

10.7 

870 

B4 

4369584.728 

402833.053 

37mmP 

0.256 

342.6 

6.4 

870 

B5 

4369585.237 

402836.011 

37mmP 

0.292 

354.4 

2.2 

870 

B6 

4369585.775 

402838.976 

37mmP 

0.335 

350.1 

5.9 

870 

C1 

4369580.060 

402824.742 

40mmP 

0.206 

348.9 

6.9 

975 

C2 

4369580.657 

402827.690 

40mmP 

0.239 

331.7 

9.5 

975 

C3 

4369581.189 

402830.657 

40mmP 

0.327 

334.1 

0.0 

975 

C4 

4369581.742 

402833.598 

40mmP 

0.379 

340.9 

0.3 

975 

C5 

4369582.294 

402836.567 

40mmP 

0.465 

343.0 

3.1 

975 

C6 

4369582.862 

402839.506 

40mmP 

0.529 

359.4 

11.5 

975 
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4.3  SITE  GEOLOGY 


The  geology  in  the  West  Jefferson,  Ohio  area  consists  of  a  glacial  till  layer,  typically  50-200  ft 
thick,  overlying  Silurian  age  carbonate  bedrock.  The  glacial  till  layer  contains  rocks  with  a  wide 
variety  of  compositions  and  sizes,  some  of  which  can  generate  significant  anomalies  at  the  site. 

Background  geology  at  APG  is  composed  predominantly  of  sandy  soils  with  minimal  magnetic 
background  interference.  The  extent  of  conductive  interference  from  possible  salt  water 
intrusion  is  minimal.  The  magnetic  soil  susceptibility  is  also  minimal  except  in  the  Small  Target 
Grid  area  where  it  is  moderately  strong. 


4.4  MUNITIONS  CONTAMINATION 

The  West  Jefferson,  Ohio  site  is  clear  of  ordnance  apart  from  seed  items.  Larger  clutter  items,  or 
items  associated  with  larger  magnetic  responses  were  cleared  when  the  grid  was  first  established. 
There  remains  a  band  of  magnetic  and  conductive  clutter  that  runs  NE-SW  across  the  top  third  of 
the  site.  This  was  largely  avoided  during  seeding.  In  addition,  new  clutter  is  occasionally  added 
in  the  form  of  aluminum  cans  which  are  often  shredded  by  mowing  machines  and  widely 
scattered. 

The  APG  site  is  assumed  to  be  clear  of  ordnance  except  for  seed  items.  Clutter  densities  are 
extremely  low  on  all  areas  except  the  Small  Target  Grid,  which  is  extremely  cluttered  and 
resembles  a  live-site  location.  Only  a  small  radius  of  approximately  Im  around  the  seed  items 
has  been  cleared  on  the  Small  Target  Grid.  The  ESTCP  Program  Office  placed  additional  clutter 
items  on  the  surface  of  the  Small  Target  Grid  prior  to  the  demonstration.  The  other  grids  have 
been  cleared  of  all  original  clutter,  although  anecdotal  evidence  suggests  that  the  fill  used  was 
not  perfectly  clean  and  several  small  background  anomalies  remain. 
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5.0  TEST  DESIGN 


5.1  CONCEPTUAL  EXPERIMENTAL  DESIGN 

This  project  was  conducted  in  several  phases.  The  first  phase  included  a  detailed  assessment  of 
the  feasibility  study  performed  prior  to  this  project,  followed  by  modeling  and  design  to  optimize 
the  transmitter  and  receiver  configuration.  The  second  phase  involved  building  the  coils  and 
testing  the  performance  of  various  firmware  settings  against  buried  targets  at  the  Camp  Sibert 
UXO  GPO  in  Alabama.  From  these  results,  a  final  set  of  operating  parameters  and  field 
procedures  were  developed.  These  were  tested  in  phase  three  with  two  field  demonstrations. 
The  first  was  a  shakedown  test  of  the  equipment  and  processing  routines  at  Battelle’s  UXO  Test 
Grid  in  West  Jefferson,  Ohio.  The  second  was  the  final  ESTCP  demonstration  at  the 
Standardized  UXO  Test  Site  at  Aberdeen  Proving  Ground,  Maryland. 

The  experimental  design  of  the  field  demonstrations  was  to  seed  and  survey  an  area,  followed  by 
data  processing  and  analysis.  For  the  West  Jefferson  study,  seeding  was  conducted  by  Battelle 
and  all  targets  were  known  to  the  investigators.  These  data  were  used  as  the  primary  training  set 
for  small  targets  (20mm  projectiles,  37mm  projectiles,  small  frag).  For  the  APG  demonstration, 
four  different  grids  were  used.  Two  were  calibration  grids  of  known  targets,  while  two  were 
blind  grids.  The  calibration  grid  data  were  used  as  training  sets  for  the  two  blind  grids.  The 
nominal  center  of  each  cell  in  the  blind  grids  was  known,  but  not  the  content  of  the  cell  or  the 
exact  target  location  (if  any).  There  were  no  double-blind  tests.  A  dig  list  was  created  for  the 
blind  grids  which  included  a  declaration  for  each  cell  (anomaly  or  blank).  If  an  anomaly  was 
detected,  the  data  were  inverted  and  classified.  The  final  dig  list  was  submitted  to  ESTCP  for 
third  party  analysis.  Final  statistics  on  the  results  were  provided  to  the  demonstration  team  for 
inclusion  in  this  report. 


Table  5:  Project  Gantt  chart. 


Phase  and  Task 

4-6/11 

7-9/11 

10-12/11 

1-3/12 

4-6/12 

7-9/12 

10-12/12 

1-3/13 

4-6/13 

7-9/13 

Contract  award 

X 

Subcontracts  issued 

X 

Feasibility  analysis 

X 

Optimization  modeling 

X 

X 

Build  coils 

X 

X 

Camp  Sibert  field  test 

X 

Camp  Sibert  data  analysis 

X 

X 

X 

West  Jefferson  field  test 

X 

West  Jefferson  data  analysis 

X 

X 

APG  calibration  survey 

X 

APG  calibration  analysis 

X 

X 

APG  small  target  survey 

X 

APG  small  target  analysis 

X 

X 

Final  reporting 

X 
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5.2  SITE  PREPARATION 


The  APG  site  was  prepared  entirely  by  ESTCP.  The  West  Jefferson  site  was  prepared  by 
Battelle.  The  West  Jefferson  site  was  mowed  and  a  pre-seed  survey  was  conducted  to  locate 
existing  anomalies  to  be  removed  or  avoided.  Several  pieces  of  scrap  were  removed.  Seed  items 
were  selected  and  placed  at  depths  from  5x  to  20x  the  target  diameter  (10cm  -  40cm  for  20mmP, 
15cm-70cm  for  37mmP).  Locations  and  depths  were  recorded  to  within  2cm  accuracy. 


Figure  7:  Photo  of  clutter  items  removed  from  West  Jefferson  UXO  Test  Grid  prior  to  seeding 
targets. 


5.3  SYSTEM  SPECIFICATIONS 

The  basic  sensor  system  is  identical  to  Battelle’s  airborne  TEM-8,  except  that  the  transmitter  and 
receiver  coil  specifications  have  been  optimized  for  the  ground-towed  platform.  The  eight 
receiver  sensors  are  0.20m  diameter  circular  induction  loops  with  their  centers  spaced  0.22m 
apart  and  covering  a  swath  of  1.75m.  The  receivers  are  oriented  horizontally  (vertical  axis 
loops)  on  the  same  plane  as  the  2.5m  x  0.75m  transmitter  loop.  The  transmitter  is  powered  by  an 
external  gas-powered  generator  and  has  a  magnetic  moment  of  1350  Am^. 

The  Tx/Rx  array  is  mounted  on  a  fiberglass  platform  and  towed  behind  a  standard  utility  vehicle. 
Navigation  was  based  on  visual  navigation  because  the  airborne  AgNav  software  did  not  allow 
sufficient  resolution.  Lines  were  spaced  1.5m  apart  to  avoid  data  gaps.  Data  positioning  utilized 
a  pair  of  dual  frequency  GPS  receivers  recording  raw  data.  These  data  were  post-processed 
against  a  known  base  station  to  generate  antenna  locations  at  a  nominal  accuracy  of  2cm.  They 
were  post-processed  against  each  other  (moving  baseline  correction)  to  calculate  system 
orientation  to  a  nominal  accuracy  of  0. 1  degrees.  Locations,  orientations  and  system  geometry 
were  combined  to  calculate  positions  for  each  individual  receiver  to  at  least  5cm  accuracy. 
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The  TEM-8g  offers  a  variety  of  operational  settings  (or  configurations).  The  console  records  all 
eight  receiver  values  at  multiple  time  gates  at  the  user  specified  base  frequency.  Time  gates  are 
geometrically  spaced  at  0.1ms,  0.2ms,  0.4ms  and  0.8ms  after  the  transmitter  shut  off.  Gates 
continue  to  be  recorded  until  the  next  on-time.  The  number  of  gates  is  therefore  controlled  by 
the  choice  of  base  frequency.  The  optimal  base  frequency  was  determined  to  be  30Hz  in  order  to 
maximize  the  number  of  off-time  data  bins.  The  down-line  data  density  is  also  controlled  by  the 
choice  of  base  frequency.  At  typical  survey  speeds  of  1.5m/s,  a  base  frequency  of  30Hz 
produces  data  spacing  of  5.0cm. 

Sensor  height  of  the  Tx/Rx  array  can  be  controlled  in  roughly  10cm  increments.  Several 
different  platform  options  are  available,  including  sled  (6cm,  10cm),  skis  (16cm,  22cm,  27cm, 
37cm,  47cm)  and  wheels  (25cm,  28cm)  depending  on  local  ground  conditions.  The  lowest  sled 
option  was  used  at  both  the  West  Jefferson  and  APG  demonstration  sites  due  to  the  flat  grassy 
terrain.  This  increased  the  soil  susceptibility  response  which  slightly  degraded  the  quality  of  the 
inversion  results,  but  it  maximized  the  response  from  the  small  deep  targets  which  were  the 
primary  objective  of  this  demonstration. 


5.4  CALIBRATION  ACTIVITIES 

Calibration  activities  followed  standard  industry  QC  procedures.  System  lag  was  determined 
using  Battelle’s  custom  impulse  coils  which  are  synchronized  with  the  GPS  PPS  and  provide 
millisecond  accuracy  lag  corrections,  and  then  verified  by  crossing  over  a  small  target  in 
opposite  directions.  Gain  settings  were  verified  by  passing  an  ISO  over  the  receivers  at  a  fixed 
height  and  comparing  the  numbers  to  previous  results.  Drift  was  corrected  by  re-occupying  the 
clean  sand-pit  calibration  site  at  periodic  intervals.  The  necessity  for  drift  correction  was 
minimized  by  an  initial  warm-up  period  sufficient  to  bring  the  internally  recorded  temperature  up 
to  a  level  approximately  15°C  above  the  ambient  outdoor  temperature.  Area  coverage  and 
system  noise  levels  were  monitored  on  a  point-by-point  basis  and  any  gaps  or  exceptions  were 
resurveyed.  Table  6  outlines  the  QC  tolerances  for  various  instrument  performance  metrics. 

Overall  functionality  of  the  system  was  monitored  on  a  continuous  basis  by  the  system  operator. 
Continuous  data  readings  are  provided  on  the  operator’s  display  and  include  response  levels, 
noise  levels,  GPS  values  and  quality,  time  synchronization  and  system  temperature. 


Table  6:  QC  Metrics. 


Parameter 

Interval 

Threshold 

Resolution  Mechanism 

Positioning 

2x  daily 

+/-10cm 

re-test  until  consistent 

Lag 

change  of  configuration 

20ms 

re-test  until  consistent 

Gain 

2x  daily 

+/-20% 

re-test  until  consistent 

Drift 

60m  in 

20ppm 

re- survey  affected  area 

Coverage 

continuous 

gaps  <25cm 

re-survey  to  fill  gap 

Noise 

60min 

<2ppm 

re- survey  affected  area 

GPS  quality 

continuous 

HDOP  <3 

re-survey  affected  area 
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5.5  DATA  COLLECTION 


Scale:  The  size,  topography,  background  geology  and  a  complete  list  of  seed  items  for  the  West 
Jefferson  and  APG  sites  are  known,  and  described  in  Section  4.  Both  sites  were  covered 
completely  with  orthogonal  line  directions.  Target  sizes  range  from  20mm  and  37mm  projectiles 
at  West  Jefferson,  25mm  to  105mm  projectiles  and  HEAT  rounds  at  the  APG  Blind  Grid,  and 
from  20mm  to  40mm  projectiles  at  the  APG  Small  Target  Grid.  The  APG  Calibration  Grid  has 
additional  items  that  are  not  used  in  this  demonstration.  This  range  of  area  size  and  target  type  is 
of  a  scale  suitable  to  demonstrate  the  primary  detection,  classification  and  productivity 
objectives  stated  above. 

Sample  density:  Cross-track  spacing  was  determined  by  the  receiver  coil  separation  of  0.22m. 
The  total  swath  is  1.75m,  but  survey  lines  are  spaced  1.5m  apart  to  provide  sufficient  overlap  to 
avoid  gaps  in  coverage.  Down-line  sample  spacing  is  determined  by  a  combination  of  base 
frequency  and  survey  speed.  At  typical  speeds  (1.5m/s)  and  frequencies  (30Hz),  down- line 
sample  spacing  is  expected  to  be  approximately  5cm.  After  surveying  in  both  directions,  data 
density  is  approximately  180  points/m^  without  considering  any  overlap  between  adjacent  lines. 
This  is  more  than  adequate  to  capture  an  entire  anomaly  given  a  system  footprint  of  25cm-30cm. 
This  is  the  maximum  resolution  for  surface  targets.  Deeper  targets  have  larger  footprints.  Data 
are  recorded  continuously  with  internal  markers  indicating  line  number.  This  simplifies  certain 
aspects  of  data  processing,  such  as  long  wavelength  drift  correction  which  spans  several  lines. 

Quality  checks:  Quality  checks  and  failure  resolution  mechanisms  are  discussed  in  section  5.4. 

Data  handling:  Data  handling  methods  are  discussed  in  Section  6. 


5.6  VALIDATION 

System  performance  was  validated  by  independent  third  party  comparison  of  the  generated  dig 
lists  to  the  blind  seed  target  locations.  No  additional  excavation  was  conducted. 
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6.0  DATA  ANALYSIS  PLAN 


6.1  PREPROCESSING 

Raw  data  followed  three  separate  streams:  base  station  GPS,  platform  GPS,  receiver  response. 
The  base  station  GPS  and  platform  GPS  data  were  combined  in  differential  post-processing  to 
determine  the  location  of  the  platform  GPS  antennae  to  a  nominal  2cm  accuracy.  The  two 
platform  GPS  datasets  were  combined  in  a  moving  baseline  differential  mode  to  determine  the 
platform  orientation.  The  locations,  orientation  and  system  geometry  were  then  used  to  calculate 
the  position  of  each  receiver  coil. 

The  raw  EM  data  (receiver  response)  were  recorded  on  the  console  at  the  chosen  base  frequency. 
All  data  were  time-stamped  to  the  GPS  PPS  signal.  These  data  were  imported  to  a  Geosoft 
database  for  processing  and  analysis.  The  differentially  corrected  GPS  data  were  then  imported 
to  the  same  database  using  the  PPS  time-stamp. 

Raw  EM  data  were  converted  from  units  of  mV  to  ppm.  A  lag  correction  was  applied  based  on 
the  appropriate  lag  test  results.  Low-pass  filters  were  applied  to  remove  any  residual  high- 
frequency  noise  from  the  EM  data.  These  were  limited  to  a  5  point  filter  with  a  frequency  cutoff 
of  6Hz.  Data  were  then  baselined  using  the  stationary  re-acquisition  data  at  the  start  and  end  of 
each  data  file  to  remove  low-frequency  drift.  Additional  high-pass  filters  (demeaning)  were 
applied  as  necessary  to  remove  any  residual  effects  of  magnetic  soil  susceptibility. 


6.2  TARGET  SELECTION  FOR  DETECTION 

Sensor  locations  were  determined  for  each  individual  receiver  and  the  full  dataset  was  then  sub¬ 
divided  for  gridding.  For  the  APG  demonstration,  nominal  cell  locations  were  provided  with  the 
objective  of  determining  the  nature  of  the  target  source  (if  any).  Anomalies  were  chosen  in  the 
vicinity  of  each  of  these  locations  and  compared  to  the  thresholds  determined  from  the 
Calibration  Grid  in  order  to  declare  whether  or  not  a  target  has  been  detected. 

In  a  typical  double-blind  or  production  survey,  gridded  data  are  used  to  pick  anomaly  locations. 
Thresholds  are  established  from  system  noise  levels  and  target  of  interest  response  amplitudes 
observed  in  the  Calibration  Grid  test  results.  Anomalies  are  picked  automatically  using  the 
“peakedness”  method  in  Geosoft.  This  approach  sets  thresholds  for  the  breadth  of  an  anomaly 
by  examining  successive  rings  of  gridded  data  around  the  central  point.  Anomaly  locations  are 
then  examined  and  adjusted  manually  as  necessary  before  inversion  and  classification. 

The  peakedness  technique  selects  anomalies  regardless  of  response  amplitude.  Therefore,  the 
threshold  amplitude  is  set  based  on  the  least  favorable  target  orientation  of  the  smallest  target  at 
the  greatest  expected  depth.  For  the  APG  demonstration,  this  is  a  horizontal  20mm  projectile  at 
0.40m  burial  depth.  Assuming  an  additional  20cm  ground  clearance  for  the  receiver  coils,  the 
total  offset  is  0.60m.  Altitude  attenuation  plots  for  vertical  and  horizontal  20mmP  are  shown  in 
Figure  8.  The  least  favorable  configuration  at  0.60m  offset  should  produce  a  target  amplitude  of 
lOppm  in  the  TEM-8g.  This  is  approximately  lOx  the  background  noise  level  and  was  the 
nominal  threshold  used  at  APG. 
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Figure  8:  Signal  attenuation  due  to  altitude  (offset)  for  a  20mm  projectile.  Vertical  (most 
favorable)  and  horizontal  (least  favorable)  orientations  are  shown.  The  lowest  response 
amplitude  at  the  maximum  depth  of  20x  diameter  (40cm  depth,  60cm  offset)  is  approximately 
lOppm. 


6.3  PARAMETER  ESTIMATION 

Data  around  each  anomaly  location  were  extracted  and  inverted  using  a  dipole  model  to 
determine  the  target  location  and  depth,  fit  coefficient,  target  inclination  and  declination,  and 
polarizabilities  (|3).  Each  of  the  three  polarizabilities  represents  the  electromagnetic  decay  of  the 
secondary  field  along  one  of  the  principle  axes  of  the  target,  and  is  independent  of  target  depth 
and  orientation.  Where  two  or  more  targets  were  clearly  indicated  within  the  same  dataset, 
multiple  dipole  models  were  used  to  determine  the  parameters  of  each  source.  In  order  to 
perform  this  inversion,  it  was  necessary  to  remove  a  certain  background  level  from  each 
anomalous  response.  This  was  usually  the  result  of  magnetic  soil  susceptibility,  although 
baselining  errors  or  inaccurate  drift  correction  may  also  have  been  at  fault.  Where  possible,  a  2D 
map  of  the  background  soil  susceptibility  response  was  constructed  for  each  time  gate  (data  bin) 
and  subtracted  from  the  original  data.  When  further  corrections  were  necessary  (approximately 
25  anomalies),  manual  intervention  was  used  to  shift  background  levels  to  achieve  a  satisfactory 
inversion  result. 
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6.4  CLASSIFICATION  AND  TRAINING 


The  data  from  the  Calibration  Grid  provided  a  sufficient  number  of  responses  to  develop  an 
initial  response  library  and  the  necessary  classification  rules.  Polarizability  data  for  additional 
unknown  targets  can  be  derived  from  MetalMapper  libraries  if  necessary. 

The  Binl  amplitude  of  the  primary  and  secondary  (3,  and  the  power  of  the  primary  decay  curve 
represent  the  three-dimensional  parameter  space  used  for  classification.  The  amplitude  of  the 
primary  and  secondary  P  are  plotted  against  each  other  to  determine  the  relative  size  and 
dimensionality  of  the  target  (e.g.  cylinder  vs.  plate).  The  decay  power  provides  an  additional 
measure  of  classification  related  to  conductivity.  This  has  been  useful  in  discriminating  between 
ordnance  and  same-size  frag,  as  well  as  between  sub-classes  of  ordnance  (e.g.  37mm  projectiles 
with  and  without  rotating  bands).  Rule-based  classification  routines  are  used  within  this 
parameter  space  to  differentiate  targets  of  interest  from  non-targets  of  interest. 

The  average  and  standard  deviation  of  each  parameter  (Binl  of  primary  (3,  Binl  of  secondary  (3, 
power  of  primary  |3)  for  each  target  type  (e.g.  20mmP,  37mmP,  40mmP)  was  calculated  from  the 
Calibration  Grid  data.  Within  this  three-dimensional  parameter  space,  the  “distance”  of  the 
measured  response  from  the  average  value  was  calculated.  The  closest  library  item  is  the  most 
likely  source.  Because  these  parameters  all  have  different  units,  the  difference  in  each  parameter 
is  normalized  by  the  standard  deviation  to  produce  a  single  unit-less  “distance”  measure  from  the 
library  average  ((measured  value  -  library  average)  /  library  standard  deviation).  If  the  response 
is  within  4a  of  the  library  average  it  is  declared  “Ordnance”.  Those  between  4a  and  6a  are 
declared  “can’t  decide”.  All  others  are  declared  “Clutter”.  All  targets  are  then  sorted  based  on 
their  “distance”  from  the  closest  average  library  point  to  form  the  final  dig  list. 


6.5  DATA  PRODUCTS 

The  dig  lists  from  the  APG  Blind  Grid  and  Small  Target  Grid  were  submitted  to  ESTCP  for 
independent  third  party  comparison  to  the  established  seed  locations.  This  list  included  the 
unique  target  ID  (Grid  name  and  cell  number),  inversion  results  (Easting  and  Northing  location, 
etc.)  and  classification  declaration  (Ordnance,  Clutter,  can’t  decide,  can’t  analyze).  Analysis  was 
broken  down  by  grid  area  (Blind  Grid,  Small  Target  Grid),  target  type  (e.g.  20mm-P,  37mm-P) 
and  depth  range  (0-1  lx  dia,  ll-20x  dia)  in  order  to  facilitate  comparison  to  the  project 
objectives.  Statistics  including  Pd,  Pcc  and  location  error  were  calculated  for  various  sub-groups 
and  for  the  seed  items  as  a  whole. 
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7.0  PERFORMANCE  ASSESSMENT 


In  this  section,  the  system  performance  is  assessed  for  two  different  demonstration  sites.  The 
first  is  the  Battelle  UXO  Test  Grid  in  West  Jefferson,  Ohio.  The  second  is  the  Standardized 
UXO  Technology  Demonstration  Site  at  Aberdeen  Proving  Ground.  The  results  from  the 
Battelle  UXO  Test  Grid  are  summarized  as  a  whole  and  used  as  a  baseline  for  establishing  the 
performance  metrics  used  at  the  APG  demonstration.  The  APG  demonstration  is  summarized 
and  the  final  performance  assessment  is  broken  down  in  detail  according  to  the  objectives  stated 
in  Section  3. 


7.1  WEST  JEFFERSON  OVERVIEW 

As  detailed  in  Section  4  the  West  Jefferson  site  was  seeded  with  20mm  projectiles,  37mm 
projectiles  and  20mm-sized  frag  at  depths  between  5x  and  20x  the  target  diameter.  The  survey 
also  covered  targets  up  to  155mm  projectiles,  but  these  were  not  analyzed  as  part  of  this 
demonstration.  The  small  target  area  was  surveyed  in  orthogonal  directions  using  a  30Hz 
transmitter  base  frequency  and  the  sled-based  platform.  All  targets  were  detected  above  a 
lOppm  threshold  (10:1  signahnoise  ratio)  regardless  of  depth,  yielding  a  Pd  of  100%  down  to 
20x  diameter. 

The  average  radial  target  location  error  was  0.06m  with  a  standard  deviation  of  0.04m.  The 
average  depth  error  was  0.02m  with  a  standard  deviation  of  0.03m.  A  small  positioning  error 
was  detected  in  the  data,  amounting  to  an  additional  2cm  of  positioning  error,  and  producing  a 
slightly  higher  standard  deviation  in  target  location  error.  This  may  also  account  for  some  of  the 
low  inversion  fit  coefficients. 


Figure  9:  Thumbnail  plots  of  the  Bin2  response  for  the  NS  (left)  and  EW  (right)  survey  lines  at 
the  West  Jefferson  Grid.  Grid  lines  are  at  10m  intervals,  color  scale  is  O-lOOppm. 
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Figure  10:  Plot  of  target  location  error  from  the  West  Jefferson  Grid. 
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Data  around  each  target  in  both  directions  were  extracted  and  inverted  for  full  polarizability 
decays.  The  primary  (3  were  strong  for  all  targets,  but  the  quality  of  the  secondary  (3  depended 
on  the  signal  strength.  Fit  coefficients  ranged  from  0.84  to  1.00  with  an  average  of  0.96.  Eleven 
targets  (out  of  49  total)  were  below  the  0.96  average,  and  seven  of  those  were  targets  (of  the  1 1 
with  poor  low  fit  coefficients)  were  at  their  maximum  depth  of  20x  diameter.  Six  (6)  other 
targets  at  their  maximum  burial  depth  were  inverted  with  better  than  average  fits. 

A  library  of  ordnance  target  responses  was  created  from  the  inversion  results.  The  average  and 
standard  deviation  of  the  peak  response  (Binl)  of  the  primary  (3,  the  peak  response  of  the 
secondary  (3,  and  the  decay  power  of  the  primary  (3  constitute  the  three  axes  of  the  classification 
space.  The  “distance”  in  the  classification  space  between  the  response  of  a  blind  target  and  the 
average  for  every  library  target  was  calculated.  Because  these  parameters  all  have  different 
units,  the  difference  was  normalized  by  the  standard  deviation  to  produce  a  single  unit-less 
“distance”  measure  from  the  library  average  (unity  is  la).  The  closest  library  item  is  the  most 
likely  source.  For  this  demonstration,  if  the  target  distance  was  within  4a  of  the  library  average 
then  a  declaration  was  made  in  favor  of  that  target.  Otherwise  it  was  declared  non-ordnance. 

A  simple,  hard  threshold  was  used  for  the  distance  in  this  initial  classification  scheme.  In  cases 
with  more  complex  combinations  of  targets,  a  second  threshold  (5a  or  6a)  would  be  used  to 
determine  the  limits  of  the  “can’t  decide”  category.  For  this  test,  no  “can’t  decide” 
classifications  were  required,  and  the  second  threshold  was  essentially  the  same  as  the  first.  This 
might  be  hoped  for  in  a  self-referenced  training  set,  but  is  not  necessarily  guaranteed.  Similarly, 
inversion  results  had  sufficiently  good  fits  that  there  were  no  “can’t  analyze”  targets.  The  result 
of  applying  this  rule-based  classification  routine  to  the  West  Jefferson  dataset  was  a  perfect  ROC 
curve. 
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Figure  11:  Plot  of  secondary  vs.  primary  polarizability  amplitude  for  ground  truth  seeds  at  West 
Jefferson  Grid. 
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Figure  12:  Plot  of  primary  polarizability  decay  power  vs.  amplitude  for  ground  truth  seeds  at 
West  Jefferson  Grid. 


Table  7:  Averaged  inversion  results  forming  initial  TEM-8g  library. 


uxo 

pi 

(avg) 

pi 

(stdev) 

P2 

(avg) 

P2 

(stdev) 

Decay 

(avg) 

Decay 

(stdev) 

20mmP 

0.064 

0.010 

0.010 

0.005 

1.61 

0.056 

37mmP 

(banded) 

0.28 

0.017 

0.081 

0.012 

1.13 

0.11 

37mmP 

(unbanded) 

0.31 

0.029 

0.062 

0.013 

1.75 

0.085 
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7.2  APG  OVERVIEW 


As  detailed  in  Section  4  the  APG  site  was  seeded  with  a  range  of  targets  from  20mm  projectiles 
to  105mm  artillery  and  HEAT  projectiles.  Four  distinct  grids  were  surveyed  -  two  calibration 
grids  and  two  blind  grids.  They  are  designated  Calibration  Grid,  Small  Calibration  Grid,  Blind 
Grid  and  Small  Target  Grid.  The  Calibration  Grid  contained  a  full  range  of  targets  at  depths 
down  to  llx  diameter.  The  Small  Calibration  Grid  contained  20mm,  37mm  and  40mm 
projectiles  at  depths  down  to  llx  diameter.  The  Blind  Grid  contained  six  different  ordnance 
types  (25mm,  37mm,  60mm,  81mm,  105mm  and  105mm  HEAT)  at  depths  down  to  llx 
diameter.  The  Small  Target  Grid  contained  20mm,  37mm  and  40mm  projectiles  down  to  20x 
diameter,  plus  additional  surface  clutter  of  unknown  size. 

All  four  sites  were  surveyed  in  orthogonal  directions  using  the  TEM-8g  with  a  30Hz  base 
frequency  on  the  sled  platform.  Navigation  was  conducted  visually  with  post-processed  DGPS 
data  positioning.  The  base  station  GPS  was  located  at  the  civil  survey  monument  provided 
(#477).  Platform  orientation  was  calculated  between  two  GPS  antenna  using  a  moving-baseline 
algorithm.  The  nominal  accuracy  of  the  GPS  antenna  locations  was  0.02m,  and  the  orientation 
accuracy  was  0.1  degree. 

Monument  #477 

Latitude  39-28-18.63880  N 

Longitude  76-07-47.71815  W 

Elevation  10.669m 

Data  processing  was  limited  to  a  low-pass  filter  with  a  6Hz  cutoff,  followed  by  linear  drift 
removal  between  periodic  background  points.  Background  readings  were  taken  at  the  start  and 
end  of  each  data  file,  approximately  every  30  minutes.  Most  background  readings  were  taken  at 
the  clean  sandy  reference  point  provided  next  to  the  Calibration  Grid.  Locations  for  each 
receiver  in  the  array  were  calculated  using  the  GPS  and  orientation  data.  The  processed 
geophysical  data  were  then  gridded  with  a  0.10m  grid  cell.  The  Small  Target  Grid  required 
additional  processing  in  the  form  of  a  correction  for  soil  susceptibility.  Background  points  were 
picked,  gridded  and  the  subtracted  from  the  original  data  to  form  the  final  dataset  for  inversion. 
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7.2.1  Calibration  Grids 


The  center  point  of  each  cell  was  taken  as  the  anomaly  location  and  array  data  were  extracted 
around  each  point  for  inversion.  Where  the  peak  data  point  within  the  extracted  dataset  fell 
below  the  lOppm  threshold,  the  cell  was  declared  empty.  On  all  other  cells,  full  polarizabilities 
were  calculated  for  each  target,  including  location  (XY),  depth  (Z),  orientation  (azimuth, 
declination)  and  fit  coefficient. 

In  the  Calibration  Grid,  all  seed  items  were  detected  above  the  lOppm  threshold,  including  the 
small  clutter  item  in  Cell  C3  which  was  approximately  half  the  size  of  a  20mm  projectile  at 
0.1  Im  depth.  The  two  20mm  projectiles  were  both  detected  with  peak  amplitudes  over  lOOppm. 
The  fit  coefficients  were  0.91  and  0.99  for  the  shallow  and  deep  targets  respectively.  At  the 
other  end  of  the  spectrum,  one  of  the  larger  targets  (Cell  El,  105mm  projectile)  saturated  the 
Binl  data  in  a  few  sensors  of  the  array  at  approximately  10,000ppm  due  to  its  shallow  and 
vertical  orientation.  This  is  not  surprising  when  the  platform  ground  clearance  has  been 
optimized  for  20mm  projectiles  at  depth.  Later  Bins  were  not  affected,  but  the  early  part  of  the 
time  decay  was  skewed.  The  fit  coefficient  was  good  (0.97),  and  the  peak  polarizability  values 
were  comparable  to  other  targets,  but  the  decay  power  was  sufficiently  different  that  this  would 
not  have  been  classified  correctly  with  the  rest  of  the  105mm  projectiles. 

The  analysis  of  the  Calibration  Grid  focused  on  grid  rows  E-K  because  these  contained  the 
targets  used  in  the  Blind  Grid.  In  this  subset  of  the  data,  four  cells  had  initial  fit  coefficients 
below  0.95.  Cells  F4  (25mm),  G1  (37mm)  and  G4  (37mm)  were  re-inverted  using  a  2-dipole 
model  (Figure  15),  which  significantly  improved  the  fit,  bringing  the  average  fit  coefficient  up  to 
0.98  with  a  standard  deviation  of  0.02.  The  fourth  cell  (J2)  contained  a  105mm  HEAT  round  and 
had  a  fit  of  0.87.  This  may  have  benefited  from  a  2-dipole  model  but  any  clutter  effect  was  less 
obvious  on  this  target  because  the  strong  signal  of  the  large  seed  item  masked  any  small  clutter. 

Target  positioning  accuracy  showed  a  radial  offset  error  of  0.08m  with  a  standard  deviation  of 
0.05m  (Figure  16).  A  consistent  4.6cm  offset  in  the  XY  locations  may  be  the  result  of  a 
documented  slip  in  the  base  station  GPS  tripod  during  the  survey.  Calculated  target  depths 
tended  to  be  overestimated  (deeper  than  actual),  with  an  average  error  of  -0.10m  and  standard 
deviation  of  0.05m.  This  would  indicate  that  ground  clearance  of  the  receiver  coils  may  be 
higher  than  expected  (0.16m  rather  than  0.06m)  due  to  the  sled  riding  up  on  small  bumps  and 
ridges.  Using  this  as  a  baseline  measurement,  subsequent  depth-below-ground  estimates  are 
based  on  a  0.16m  ground  clearance. 
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Figure  13:  Plot  of  Bin2  response  at  APG  Calibration  Grid. 
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Figure  14:  Plot  of  Bin2  response  at  APG  Calibration  Grid. 
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Figure  15:  Overlapping  contours  of  measured  and  modeled  (from  inverted  target)  results  of 
2-dipole  models  for  anomalies  in  Calibration  Grid  Cells  F4  (25mm),  G1  (37mm)  and  G4 
(37mm). 
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igure  16:  Calibration  Grid  location  error  plot.  The  average  offset  is  shown  in  red.  The 
standard  deviation  is  0.05m 


The  inversion  results  from  the  Calibration  Grid  and  the  Small  Target  Calibration  Grid  were 
added  to  those  from  the  West  Jefferson  dataset  to  produce  a  library  of  targets  that  were  used  to 
classify  the  results  of  the  APG  Blind  Grid  and  Small  Target  Grid  (Figure  17  and  Figure  18). 
During  the  analysis  of  the  Blind  Grid  results,  it  was  determined  by  SAIC  from  their  previous 
experience  that  there  was  an  additional  variety  of  81mm  target  in  the  Blind  Grid  that  was  not 
present  in  the  Calibration  Grid.  This  item  was  added  to  the  library  based  on  their 
recommendation.  The  West  Jefferson  results  demonstrated  a  second  type  of  37mm  target.  This 
sub-group  was  not  evident  in  the  Calibration  or  Small  Target  Calibration  Grids,  but  several 
anomalies  in  the  Small  Target  (Blind)  Grid  matched  this  target  type  and  so  this  sub-group  was 
retained  in  the  reference  list  for  classification  of  the  APG  data. 

The  25mm  targets  showed  a  wide  scatter  in  the  parameter  space  plots,  but  do  not  appear  to  form 
separate  sub-groups.  The  20mm  targets  also  show  a  wide  scatter,  but  in  this  case  they  appear  to 
form  at  least  two  or  possibly  three  separate  groups.  These  may  be  legitimate  variants,  or  the 
spread  may  be  the  result  of  weak  SNR  since  these  targets  are  an  order  of  magnitude  smaller  in 
both  primary  and  secondary  |3  than  the  37mm  or  25mm  targets.  When  compared  to  the  inversion 
results  from  the  Blind  Grid  and  Small  Target  Grid,  the  West  Jefferson  calibration  items  were 
clearly  not  of  the  same  variety  of  those  used  at  APG  and  so  this  sub-group  was  dropped  from  the 
library  for  the  purposes  of  classifying  the  APG  Small  Target  Grid  data  (see  Figure  23). 
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Figure  17:  Plot  of  secondary  vs.  primary  polarizability  amplitude  for  calibration  items.  Points 
include  individual  results  from  the  West  Jefferson  and  APG  Calibration  grids,  as  well  as  the  final 
Library  reference  point  used  for  classification  of  the  APG  grids. 
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Figure  18:  Plot  of  primary  polarizability  decay  power  vs.  amplitude  for  calibration  items.  Points 
include  individual  results  from  the  West  Jefferson  and  APG  Calibration  grids,  as  well  as  the  final 
Library  reference  point  used  for  classification  of  the  APG  grids. 
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7.2.2  Blind  Grid 


In  the  Blind  Grid,  all  targets  above  the  lOppm  threshold  were  selected.  Those  cells  below  the 
threshold  were  declared  Blank.  Targets  were  inverted  and  classified  according  to  the  procedure 
detailed  above.  This  list  was  submitted  to  ESTCP  for  analysis.  A  second  list  was  prepared  by 
SAIC  based  on  their  shape/scale  classification  system  and  was  also  submitted  for  comparison. 
Both  lists  were  based  on  the  same  polarizability  results,  but  used  different  classification 
procedures. 

The  differences  between  the  two  dig  lists  were  relatively  minor.  Most  related  to  whether  a 
specific  target  should  be  classified  as  clutter  vs.  an  unknown  ordnance  type.  The  only 
substantive  differences  were  (a)  SAIC  classified  one  target  as  a  105H  when  Battelle  classified  it 
as  a  105  projectile  and  (b)  SAIC  classified  one  target  as  a  105  projectile  when  Battelle  classified 
it  as  a  105H.  In  both  cases,  SAIC  was  correct. 

Plots  of  the  polarizability  parameter  space  are  presented  below.  This  illustrates  the  clustering  of 
the  Blind  Grid  inversion  results  about  the  Calibration  Grid  library  results  (Figure  20). 

Results  of  the  ground  truth  analysis  were  presented  in  several  formats.  The  first  is  a  Receiver 
Operating  Characteristic  (ROC)  curve  (Figure  21).  This  shows  the  probability  of  detecting  a  true 
target  (ordnance)  against  the  probability  of  detecting  a  false  target  (clutter)  when  using  a 
prioritized  dig  list.  Two  lines  are  plotted.  The  orange  line  is  the  ROC  curve  if  the  dig  list  is 
sorted  based  on  response  amplitude  only.  The  blue  line  is  for  the  dig  list  based  on  the 
discrimination  results.  The  difference  between  the  two  illustrates  the  amount  of  clutter  on  the 
site. 

Black  horizontal  lines  are  used  to  illustrate  the  performance  at  two  specified  points:  at  the 
response  stage  theshold  (orange  star),  representing  the  point  below  which  targets  are  not 
considered  detectable;  and  at  the  discrimination  stage  threshold  (green  star),  defining  the  subset 
of  targets  the  demonstrator  would  recommend  digging  based  on  discrimination.  The  response 
stage  threshold  is  at  an  amplitude  of  lOppm,  which  is  roughly  lOx  the  noise  floor  of  the  sensor 
system. 
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Figure  19:  Plot  of  Bin2  response  at  APG  Calibration  Grid. 
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Figure  20:  (a-left)  Plot  of  secondary  vs.  primary  polarizability  amplitude  and  (b-right)  primary  polarizability  decay  power  vs. 
amplitude.  Points  include  the  Library  reference  points  and  all  detected  targets  from  the  APG  Blind  Grid. 
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Figure  21:  ROC  curve  for  TEM-8g  at  Blind  Grid.  Probability  of  detection  for  response  and 
discrimination  stages  versus  their  respective  probability  of  false  positive. 


The  results  presented  here  illustrate  near  perfect  discrimination  in  a  lightly  cluttered 
environment.  In  retrospect,  the  threshold  limit  was  set  slightly  higher  than  necessary,  allowing 
some  clutter  items  into  the  classified  dig  list. 

Performance  was  also  detailed  by  ordnance  type  in  tabular  format  (Table  8).  The  response  stage 
results  are  derived  from  the  list  of  anomalies  above  the  noise  level.  The  results  for  the 
discrimination  stage  are  derived  from  the  recommended  threshold  for  optimizing  munitions 
related  cleanup  by  minimizing  false  alarm  digs  and  maximizing  munitions  recovery. 
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Table  8:  Tabulated  Pd  results  for  the  Blind  Grid  by  ordnance  type  and  depth. 


Response  Stage 

Discrimination  Stage 

Munitions^ 

by  type 

pddlSC: 

Scores 

All  Types 

105-mm 

81/60-mm 

37/25-mm 

All  Types 

105-mm 

81/60-mm 

37/25-mm 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

By  Depth^ 

0  to  4D 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

4D  to  8D 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

8D  to  12D 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

LOO 

Table  9:  Blind  Grid  classification  accuracy  for  Battelle  and  SAIC  derived  dig  lists.  Battelle’s 
classification  system  misidentified  one  105H  as  a  105  projectile,  and  one  105  projectile  as  a 
105H  when  compared  to  the  SAIC  dig  list. _ 


Size 

Percentage  Correct 
(Battelle) 

Percent  Correct 
(SAIC) 

25mm 

100% 

100% 

37mm 

100% 

100% 

60mm 

100% 

100% 

81mm 

93% 

93% 

105mm 

93% 

100% 

105  artillery 

93% 

100% 

Overall 

97% 

99% 
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7.2.3  Small  Target  Grid 


In  the  Small  Target  Grid,  all  targets  above  the  lOppm  threshold  were  selected.  Those  cells  below 
the  threshold  were  declared  Blank.  Targets  were  inverted  and  classified  according  to  the 
procedure  detailed  above.  This  list  was  submitted  to  ESTCP  for  analysis.  A  second  list  based  on 
SAIC’s  shape/scale  classification  system  (this  time  executed  by  Battelle)  was  also  submitted  for 
comparison.  Both  lists  were  based  on  the  same  polarizability  results,  but  used  different 
classification  procedures. 

The  differences  between  the  two  dig  lists  were  relatively  minor.  Both  lists  detected  all  targets 
above  the  noise  threshold.  In  classification,  both  lists  used  a  threshold  below  the  100%  Pd  level. 
The  Battelle  list  used  a  slightly  lower  discrimination  threshold  than  SAIC.  This  captured  more 
of  the  ordnance  and  resulted  in  slightly  better  Pdisc  statistics  at  the  cost  of  higher  Pcc  (reported 
statistics  are  based  on  all  digs  above  the  discrimination  threshold). 

Plots  of  the  polarizability  parameter  space  are  presented  in  Figure  23.  This  illustrates  the 
clustering  of  the  Small  Target  Grid  inversion  results  about  the  Library  reference  points. 
Classification  based  on  these  results  produced  the  ROC  curves  presented  in  Figure  24  and  Figure 
25. 

Scoring  results  were  divided  into  capped  and  uncapped  subgroups.  The  uncapped  group 
replicates  the  standard  seeding  procedure  used  throughout  the  APG  demonstration  facility  where 
the  area  around  the  target  has  been  cleared  of  all  (most)  metallic  debris.  The  capped  group  has 
deliberate  clutter  items  placed  directly  on  top  of  the  target  location  in  order  to  mask  the  signature 
and  make  classification  more  difficult.  This  is  closer  to  what  may  be  presumed  to  be  found  in  a 
live-site  situation  rather  than  a  typical  controlled  test  plot.  The  combination  of  small  targets, 
increased  burial  depth,  native  clutter  and  high  levels  of  soil  susceptibility,  together  represent  a 
worst-case  scenario  for  APG  demonstration  purposes. 
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Figure  22:  Plot  of  Bin2  response  at  APG  Calibration  Grid  after  removal  of  background  susceptibility. 
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Figure  23:  (a-left)  Plot  of  secondary  vs.  primary  polarizability  amplitude  and  (b-right)  primary  polarizability  decay  power  vs. 
amplitude.  Points  include  the  Library  reference  points  and  all  detected  targets  from  the  APG  Small  Target  Grid.  Note  that  the  variant 
of  20mm  projectiles  used  at  the  West  Jefferson  test  grid  are  not  represented  in  this  dataset. 
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Figure  24: 

(a-left)  ROC  curve  from  Battelle  list,  Small  Target  Grid,  capped  cells,  all  ordnance  types,  depths  to  20x  diameter, 
(b-right)  ROC  curve  from  SAIC  list,  Small  Target  Grid,  capped  cells,  all  ordnance  types,  depths  to  20x  diameter. 
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Prob  of  Detection  Prob  of  Detection 


0  0.2  0.4  0.6  0.8  1 

Prob  of  False  Positive 


Table  10:  Tabulated  Pd  results  for  the  Small  Target  grid  (eapped)  by  ordnanee  type  and  depth 


using  the  Battelle  dig  list. 


Response  Stage 

Discrimination  Stage 

Munitions^ 

Scores 

pr:  by  type 

P/'"":  by  type 

All  Types 

40-mm 

37-mm 

20-mm 

All  Types 

40-mm 

37-mm 

20-mm 

1.000 

1.000 

1.000 

1.000 

0.956 

1.000 

1.000 

0.867 

By  Depth'^ 

Oto  4D 

1.000 

1.000 

NA 

NA 

1.000 

1.000 

NA 

NA 

4D  to  8D 

1.000 

1.000 

1.000 

1.000 

0.943 

1.000 

1.000 

0.778 

8D  to  12D 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

>12D 

1.000 

1.000 

1.000 

1.000 

0.867 

1.000 

1.000 

0.714 

Table  11:  Tabulated  Pd  results  for  the  Small  Target  grid  (uncapped)  by  ordnance  type  and  depth 


using  the  Battelle  dig  list. 


Response  Stage 

Discrimination  Stage 

Munitions^ 

Scores 

pr:  by  type 

/>/“••  by  type 

All  Types 

40-mm 

37-mm 

20-mm 

All  Types 

40-mm 

37-mm 

20-mm 

1.000 

1.000 

1.000 

1.000 

0.967 

1.000 

1.000 

0.900 

By  Depth'^ 

0  to  4D 

1.000 

NA 

1.000 

1.000 

1.000 

NA 

1.000 

1.000 

4D  to  8D 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

8D  to  12D 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

>12D 

1.000 

1.000 

1.000 

1.000 

0.800 

1.000 

1.000 

0.500 

Table  12:  Small  Target  grid  classification  accuracy  for  Battelle  and  SAIC  derived  dig  lists.  The 
improved  Battelle  results  may  reflect  the  addition  of  a  second  37mm  variant  in  the  library 


selection,  or  the  lower  thresho^ 

d  point. 

Size 

Percentage  Correct 
(Battelle,  capped) 

Percentage  Correct 
(Battelle,  uncapped) 

Percentage  Correct 
(SAIC,  capped) 

Percentage  Correct 
(SAIC,  uncapped) 

20-mm 

0.77 

0.90 

0.80 

0.70 

37-mm 

0.97 

1.00 

0.93 

0.90 

40-mm 

1.00 

1.00 

1.00 

1.00 

Overall 

0.91 

0.97 

0.91 

0.87 
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7.2.4  Analysis 


Data  collection  at  the  APG  site  was  relatively  simple.  The  logistics  and  terrain  were  ideal.  The 
resulting  data  were  relatively  free  of  instrument  noise.  The  Small  Target  grid  had  considerable 
background  geophysical  noise  from  pre-existing  clutter  and  soil  susceptibility. 

Data  processing  followed  a  routine  comparable  to  that  of  an  array  of  EM61s.  A  small  low-pass 
fdter  was  followed  by  baseline  leveling  between  background  points  collected  over  the  clean  sand 
pit  at  the  north  end  of  the  area.  The  data  from  Small  Target  grid  required  additional  background 
removal  of  the  soil  susceptibility  before  inversion. 

Inversion  was  run  mostly  in  an  automated  fashion,  which  included  up  to  four-dipole  models  for 
each  cell.  Some  manual  intervention  was  required  to  obtain  acceptable  inversion  results  on  25 
cells,  of  which  7  remained  unacceptable. 

Classification  was  based  on  the  inversion  results  using  two  different  techniques.  The  SAIC 
method  used  the  amplitude  and  shape  of  the  primary  polarizability  curve  only  to  match  library 
points.  The  Battelle  method  included  the  secondary  curves.  Discrimination  thresholds  were 
established  independently  for  both  approaches  based  on  the  last  reliable  ordnance  declaration. 
The  two  results  are  very  similar  but  the  Battelle  list  used  a  lower  discrimination  threshold  which 
skews  some  of  the  numbers  to  higher  Pdisc  and  lower  FP  Rejection.  Except  where  specified,  this 
report  considers  the  Battelle  results  in  the  analysis.  The  Response  Stage  of  the  dig  list  is  based 
entirely  on  response  amplitude.  As  such  it  is  only  an  intermediate  product  and  analysis  will 
focus  on  the  Discrimination  Stage  results. 

The  scores  for  the  Blind  Grid  demonstrate  near  perfect  detection,  classification  and  clutter 
rejection  capabilities  for  targets  between  25mm  and  105mm  sizes  at  standard  depths.  The  results 
appear  to  be  better  for  small  targets  rather  than  large  ones.  This  is  due  to  the  fact  that  the  system 
operating  parameters  were  optimized  for  20mm  targets  at  depth.  Larger  targets,  particularly  the 
105mm  HEAT  and  projectiles,  and  the  shallow,  vertically-oriented  81mm  mortars  would 
occasionally  saturate  the  response  making  the  inversion  and  classification  inaccurate.  Given  the 
size  and  depth  of  the  targets  in  this  grid,  the  Blind  Grid  results  are  the  ones  that  should  be  used 
when  comparing  this  system’s  performance  to  that  of  other  dynamic  discrimination  instruments. 

The  Small  Target  grid  results  were  excellent,  but  require  more  detailed  analysis.  The  “capped” 
results  represent  the  worst  case  scenario.  In  this  case,  the  “elbow”  of  the  ROC  curve  is  at 
approximately  Pdisc=85%  and  FP=15%.  The  list  eventually  reached  Pd=100%  but  the 
discrimination  threshold  was  set  higher  at  Pdisc=96%  and  FP=48%.  The  “uncapped”  results 
were  slightly  better  with  an  elbow  at  Pdisc=90%  and  FP=10%  and  a  threshold  point  at 
Pdisc=97%  and  FP=39%.  The  additional  clutter  cap  therefore  had  no  impact  on  the  Pdisc  but 
increase  the  FP  by  approximately  10%.  This  would  imply  that  the  cap  disguised  the  clutter 
response,  making  it  more  likely  to  be  declared  ordnance,  presumably  by  adding  ambiguity  to  the 
inversion  results. 

The  Blind  Grid  and  the  Small  Target  grid  results  can  be  compared  by  looking  at  the  respective 
ROC  curves.  The  ROC  curve  for  the  uncapped  cells  with  37mm  and  40mm  ordnance  types  is 
comparable  to  the  conditions  in  the  Blind  Grid.  The  ordnance  size  at  least  partially  overlaps  and 
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there  is  no  additional  clutter  cap  directly  over  the  target.  The  primary  difference  here  is  that  the 
burial  depths  extend  to  20x  diameter,  although  the  change  in  background  conditions  (soil 
susceptibility  and  native  clutter)  is  also  a  factor.  The  change  between  Figure  21  and  Figure  25c 
therefore  demonstrates  the  reduction  in  classification  capabilities  (Pd  detection  remains  at  100%) 
due  to  depth  for  this  target  size.  In  this  case,  the  Pdisc  and  FP  Rejection  (1-FP)  numbers  drop 
from  1.00/0.87  to  1.00/0.65  at  the  discrimination  threshold  point.  This  would  indicate  that 
roughly  20%  more  clutter  items  would  be  dug  by  doubling  the  detection  depth  for  targets  in  the 
37mm  to  40mm  size  range. 

The  choice  of  library  reference  points  necessarily  has  a  significant  impact  on  the  classification 
results.  The  40mm  library  was  based  entirely  on  the  results  from  the  APG  Calibration  Grid.  The 
37mm  and  20mm  library  included  results  from  the  West  Jefferson  Test  Grid.  The  40mm  targets 
showed  good  signahnoise  ratios  and  a  tight  clustering  about  the  library  point.  The  20mm  targets 
showed  an  order  of  magnitude  weaker  response  in  the  primary  and  secondary  polarizabilities. 
This  resulted  in  generally  poorer  inversion  fits,  and  a  correspondingly  broader  target  scatter. 
There  also  appears  to  be  a  significant  difference  in  response  between  the  20mm  ordnance  used  at 
West  Jefferson  and  those  at  APG,  even  though  both  appear  to  have  come  from  a  common  source 
(West  Jefferson  seed  targets  were  all  labeled  as  ATC).  None  of  the  Small  Target  Grid  inversion 
results  matched  the  calibration  measurements  from  West  Jefferson,  so  this  reference  point  was 
dropped  from  the  library  for  the  purposes  of  classification  of  APG  data. 

The  37mm  targets  were  known  to  have  at  least  two  different  variants  (with  and  without  rotating 
band).  These  were  represented  in  the  West  Jefferson  library  measurements  but  were  not 
observed  in  the  APG  Calibration  grid.  However,  there  were  sufficient  responses  in  the  Small 
Target  Grid  that  matched  the  second  variant  that  both  variants  were  included  in  the  classification 
process.  If  the  Small  Target  Grid  seed  items  match  the  Calibration  items  (one  variant  only),  this 
may  account  for  some  of  the  False  Positive  responses  observed  in  the  final  scoring.  A 
comparison  of  the  ROC  curves  with  and  without  the  20mm  targets  (Figure  25a  and  Figure  25c) 
indicates  most  of  the  FPs  result  from  the  classification  of  20mm  targets.  With  so  few  FPs  in  the 
37mm  category  using  two  variants  of  37mm,  this  would  indicate  that  both  variants  of  37mm  are 
likely  present  in  the  Small  Target  Grid.  In  an  active  field  project,  the  presence  or  absence  of  the 
second  variant  would  be  determined  early  in  the  excavation  process  and  the  dig  list  would  be 
modified  accordingly  in  order  to  maximize  efficiency. 

The  tabulated  results  show  that  all  of  the  40mm  and  37mm  targets  at  all  depths  both  with  and 
without  caps  were  detected  above  the  discrimination  threshold.  The  20mm  targets  were  all 
detected  above  the  noise  threshold,  but  not  above  the  discrimination  threshold.  A  lower 
threshold  would  improve  the  Pd  results  at  the  expense  of  the  FPs.  At  the  current  discrimination 
threshold,  the  uncapped  seeds  were  all  detected  down  to  llx  diameter,  but  the  deeper  targets 
were  not.  The  clutter  cap  made  discrimination  more  difficult  even  for  the  more  shallow  targets. 
It  is  interesting  to  note  that  the  capped  targets  at  20x  depth  showed  a  higher  Pdisc  than  the 
uncapped  targets  at  the  same  depth.  This  is  presumably  because  the  local  site  variations  in  soil 
susceptibility  and  native  clutter  have  a  larger  impact  on  the  results  than  the  emplaced  clutter  cap. 
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7.2.5  Conclusions 


All  targets  in  the  Blind  Grid  and  Small  Target  Grid  were  detected  in  the  Response  Stage, 
resulting  in  Pd  of  1.00.  In  the  Discrimination  Stage,  all  targets  in  the  Blind  Grid  and  all  37mm 
and  40mm  targets  in  the  Small  Target  Grid  were  detected  at  all  depths,  resulting  in  a  Pdisc  of 
1.00.  The  20mm  targets  had  Pdisc  reduced  to  0.87/0.90  (capped/uncapped),  primarily  at  the 
greater  depths.  Classification  of  clutter  (Pcc)  was  slightly  lower  than  the  corresponding  Pdisc, 
reflecting  a  cautious  approach  to  declarations.  Pcc  was  0.87  in  the  Blind  Grid,  and  0.52/0.61 
(capped/uncapped)  in  the  Small  Target  Grid.  This  last  metric  was  the  only  one  that  came  close 
to  falling  below  the  design  expectations.  All  metrics  surpassed  those  of  the  existing  technology 
standard  (EM61  array). 

In  projecting  these  results  to  other  sites,  terrain  and  obstacles  may  require  additional  ground 
clearance  of  the  instrument.  Based  on  the  amplitude  attenuation  for  a  20mm  target  in  its  least 
favorable  orientation,  a  lOppm  noise  threshold  falls  at  a  60cm  offset.  The  sled  configuration 
used  at  APG  had  a  ground  clearance  of  6cm.  Higher  ground  clearance  options  are  available  but 
will  necessarily  result  in  poorer  performance  at  extreme  depths.  For  example,  with  a 
Discrimination  Stage  Pdisc  of  0.87  for  a  20mmP  at  a  20x  burial  depth  (offset  of  46cm),  one 
would  expect  the  same  Pdisc  at  the  same  overall  offset,  such  as  llx  burial  depth  plus  23cm 
ground  clearance.  Similarly,  larger  targets  could  get  the  same  100%  Pdisc  at  llx  burial  depth 
with  much  greater  ground  clearance  if  necessary. 

In  conclusion,  this  project  met  all  of  the  original  expectations  for  small  target  detection  at  depth, 
and  greatly  exceeded  expectations  in  terms  of  discrimination  and  classification.  Originally 
intended  purely  as  a  detection  tool  and  replacement  for  the  standard  EM-61  array,  this  system 
has  demonstrated  superior  depth  detection  and  comparable  discrimination  capabilities  to  other 
dynamic  classification  tools  as  demonstrated  at  the  APG  site. 
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8.0  COST  ASSESSMENT 


The  expected  operational  costs  for  this  technology  have  been  developed  based  on  the  actual  costs 
incurred  after  adjustment  for  circumstances  unique  to  this  demonstration.  The  resulting  cost 
model  is  broken  out  into  the  follow  categories:  instrument  costs,  mobilization,  equipment  setup 
and  calibration,  survey  costs  per  acre,  demobilization,  data  analysis.  Cost  tracking  elements  for 
each  of  these  are  shown  in  Table  13. 


Table  13:  Cost  Model  Metrics 


Cost  element 

Data  to  be  tracked 

Instrument  costs 

engineering  estimates  based  on  current  build 

Mobilization 

actual  demonstration  costs 

Equipment  setup/cal 

hours  and  personnel  required 

Survey  costs 

hours  and  personnel  required  for  each  configuration  demonstration, 
reduced  to  a  cost  per  hectare 

Data  processing 

hours  and  personnel  required  for  each  configuration,  reduced  to  a 
cost  per  hectare 

8.1  COST  MODEL 

Instrument  costs  for  this  demonstration  were  largely  covered  by  using  existing  electronics.  This 
includes  the  controller  and  data  logging  console,  multiple  GPS  units,  navigation  system  and 
power  supply.  New  equipment  included  the  transmitter  and  receiver  coils,  cables  and 
connectors.  A  variety  of  tow  platforms  were  also  constructed.  In  total,  five  different  platforms 
options  were  constructed  including  a  fiberglass  version  with  options  for  wheels  (2)  or  skis  (2), 
and  a  sled  (1).  The  tow  vehicle  was  rented  from  a  local  equipment  supply  firm.  The  console 
was  designed  for  airborne  survey  applications  and  has  considerable  redundancy.  The  cost  to 
replicate  the  total  system  including  the  airborne  data  console  is  given  below.  In  a  production 
setting,  the  console  configuration  could  be  much  simpler  and  less  expensive. 

Total  prototype  equipment  cost:  $180k 

Mobilization  costs  included  one  day  of  packing,  one  day  of  driving,  one  day  return,  one  day 
unpacking  for  two  people  each  day.  Travel  costs  were  at  government  per  diem  rates.  Actual 
costs  will  vary  depending  on  the  mileage,  distance  and  personnel  involved. 

Mob/demob  costs :  $  1 2k 

Calibration  consisted  of  warming  up  the  instrument  and  taking  the  prescribed  QC  measurements. 
This  requires  approximately  1  hr.  Equipment  setup,  consisting  of  unpacking  and  assembling  the 
system  requires  approximately  3  hrs.  Costs  are  calculated  for  a  total  of  4  hrs. 

Setup  and  calibration  costs:  $1.8k 
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Survey  costs  are  based  on  a  3  person  team.  It  required  1  hour  (55-60  minutes)  to  complete  a 
single  full  coverage  pass  over  the  Small  Target  Grid  (0.28  ha)  for  each  configuration  tested.  This 
included  relocating  the  array  to  the  quiet  calibration  point  at  the  other  end  of  the  site  every  30 
minutes  (start,  middle  and  end  of  a  pass).  Two  orthogonal  passes  were  required  to  provide 
sufficient  data  to  perform  inversion.  Production  rates  are  therefore  0.14  ha/hr.  Costs  include 
labor,  travel  and  equipment  rental,  and  totaled  $450  per  hour. 

Survey  costs:  $3.2k/ha 

Actual  data  processing  costs  for  the  Blind  Grid  (0.1 6ha)  and  Small  Target  Grid  (0.28ha)  totaled 
$15k  for  this  project,  including  one  processing  geophysicist  and  one  inversion  specialist.  This 
covers  three  passes  over  each  grid  using  different  ground-clearance  options,  although  only  one 
configuration  was  used  in  the  final  analysis.  This  amount  does  not  include  the  cost  to  develop 
the  basic  processing  and  inversion  routines,  but  it  does  include  time  to  develop  new  processing 
routines  to  handle  the  high  magnetic  susceptibility  in  the  soils  at  the  Small  Target  Grid  and  to 
develop  classification  routines  from  multi-dipole  inversion  results.  If  the  project  costs  are 
assumed  to  be  related  entirely  to  a  single  pass  over  the  Small  Target  Grid  and  the  Blind  Grid,  the 
cost  is  approximately  $34k/ha.  In  a  production  setting,  estimated  processing  costs  would  be 
much  lower. 

Estimated  production  processing  costs:  $3.4kyha 
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8.2  COST  DRIVERS 


Cost  drivers  are  relatively  simple.  Deployment  issues  (terrain  and  vegetation)  may  impact  the 
utility  of  the  collected  data  by  limiting  coverage  or  ground  clearance;  but  they  have  only  minor 
impact  on  the  costs.  Mobilization  and  setup  are  no  more  difficult  or  expensive  than  an  array  of 
standard  EM-61  sensors.  Survey  costs  may  initially  appear  to  be  high  due  to  the  requirement  for 
bi-directional  surveying,  but  the  wide  swath  width  and  relatively  high  survey  speeds  more  than 
compensate.  Survey  costs  should  therefore  be  twice  those  of  a  detection-only  survey  with  an 
EM-61  array,  but  half  that  of  a  dynamic  survey  with  a  classification  instrument  such  as 
MetalMapper.  Initial  processing  costs  should  also  be  comparable  to  an  array  of  EM-6  Is. 
Inversion  and  classification  costs  should  be  slightly  less  than  those  of  a  dynamic  MetalMapper 
due  to  the  simpler  data  presentation  requirements. 

A  comparison  of  productivity  statistics  for  various  geophysical  systems  is  provided  in  Table  14. 
These  are  estimates  only,  but  demonstrate  that  the  TEM-8g  has  approximately  half  the 
productivity  of  an  EM-61  array,  but  twice  that  of  dynamic  classification  systems.  The  “time  on 
grid”  number  is  based  on  the  EM-61  array  as  the  industry  standard  instrument.  In  terms  of  cost 
drivers,  the  additional  time  on  grid  relative  to  the  EM-61  array  must  be  offset  by  the  detection 
depth  and  classification  capabilities  of  the  TEM-8g.  The  data  density  numbers  are  significant  in 
that  they  illustrate  the  resolution  of  the  various  systems  and  reflect  their  ability  to  detect  and 
isolate  small  ordnance  types  and/or  closely  spaced  debris. 


Table  14:  Productivity  statistics  for  a  variety  of  detection  and  classification  instruments. 


Instrument 

EM61 -array 

TEMTADS 

2x2 

ALLTEM 

Dynamic 

MM 

TEM-8g 

Line  Spacing  (m) 

2.0 

0.75 

0.5 

0.75 

1.5 

Speed  (m/s) 

1.0 

0.5 

1.0 

0.5 

1.5 

#  Passes 

1 

1 

1 

1 

2 

Productivity  (m  /s) 

2.0 

0.37 

0.50 

0.37 

1.1 

Relative  Time  on  Grid 

lx 

5.5x 

4x 

5.5x 

2x 

Sample  Rate  (Hz) 

10 

10 

10 

10 

30 

Data  Spacing  (m) 

0.75 

0.5 

0.5 

0.75 

0.22 

Data  Density  (1/m^) 

13.3 

40.0 

20.0 

26.6 

180 
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8.3  COST  BENEFIT 


The  costs  benefits  of  this  technology  fall  into  two  categories.  The  first  is  improved  depth 
detection  for  small  targets  when  compared  to  the  existing  technology  (EM-61  array).  This 
system  effectively  doubles  the  reliable  detection  depth,  thereby  halving  the  geophysical  survey 
costs  required  to  clear  an  area  of  small  targets  down  to  a  reasonable  depth. 

The  second  benefit  is  the  capability  of  ordnance  classification  from  a  dynamic  platform.  The 
reliability  of  the  inversion  results  from  the  TEM-8g  greatly  surpasses  that  of  the  traditional 
technology  it  is  designed  to  replace.  Other  “next-generation”  dynamic  systems  also  offer  this 
capability,  some  with  greater  confidence.  However,  none  have  demonstrated  the  same  reliability 
with  regard  to  small  targets,  or  the  rapid  productivity  (wide  swath  width),  or  the  “20x”  depth 
capability  of  the  TEM-8g. 

At  the  very  least  this  system  can  double  the  depth  of  investigation,  improve  detection  resolution 
and  reduce  the  number  of  cued  investigations  required  during  a  standard  two-stage  geophysical 
program.  At  best,  it  may  replace  the  need  for  cued  investigations  at  many  sites. 
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9.0  IMPLEMENTATION  ISSUES 


The  current  prototype  system  is  immediately  available  for  implementation  on  small  scale 
projects.  Larger  projects  will  require  a  more  ruggedized  platform  to  handle  more  difficult 
terrains  for  long  periods.  A  commercial  version  of  the  system  would  require  the  design  and 
manufacture  of  a  simplified  controlling  console  (the  current  console  is  primarily  designed  for 
airborne  operations). 

All  data  processing  is  currently  handled  within  Geosoft,  but  a  production  version  of  the  inversion 
software  is  required  for  routine  work.  Basic  geophysical  knowledge  is  required  to  operate  and 
process  the  data.  Any  geophysicist  familiar  with  the  workflow  for  an  EM-61  array  can  handle 
the  basic  processing.  Analysis  of  the  inversion  results  has  largely  been  automated,  but  additional 
experience  is  required  to  optimize  various  parameters. 

End  users  will  be  reluctant  to  accept  results  from  this  (or  any)  new  technology  on  the  basis  of  a 
single  controlled-site  demonstration.  Additional  demonstrations  at  live-sites  will  be  required  to 
mitigate  those  concerns.  No  potential  regulatory  restrictions  have  been  identified  for  this 
technology. 
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Appendix  A. 


POINTS  OF  CONTACT 


T.  Jeffrey  Gamey 

Battelle,  lOOA  Dormer  Dr.,  Oak  Ridge,  TN  37830 
(865)  599-0820  gamevti@battelle.org 
Geophysicist  -  Principle  Investigator 

William  Doll 

Battelle,  lOOA  Donner  Dr.,  Oak  Ridge,  TN  37830 
(865)  599-6165  dollw@battelle.org 

Geophysicist  -  modeling  assessment,  data  collection,  data  analysis 
Scott  Holladay 

Geosensors,  66  Mann  Ave.,  Toronto,  ON  M4S-2Y3 
(416)  483-4691  scott.holladav@geosensors.com 

Geophysicist  -  array  design  and  construction,  electronics  support,  data  analysis 
Bruce  Barrow 

Leidos  (formerly  SAIC),  4001  North  Fairfax  Dr.,  Arlington,  VA  22203 
(703)  276-4804  bruce.i.barrow@leidos.com 
Geophysicist  -  modeling  and  inversion 

Robert  Selfridge 

Corps  of  Engineers,  4820  University  Square,  Huntsville,  AL  35816-1822 
(256)  895-1887  bob.i .selfridge@hndO  1  .usace.armv.mil 
Geophysicist  -  autonomous  platform  integration,  ground  truth  support 
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